-- Logs begin at Wed 2022-08-17 14:05:23 UTC, end at Wed 2022-08-17 15:12:32 UTC. -- Aug 17 14:45:25.470035 dv-osbrick-853500-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 17 14:45:25.479938 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 17 14:45:25.481952 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 14:45:25 2022] *** Aug 17 14:45:25.481952 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 14:45:25.481952 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 14:45:25.481952 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: nodename: dv-osbrick-853500-1-ceph Aug 17 14:45:25.481952 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: machine: x86_64 Aug 17 14:45:25.481952 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: clock source: unix Aug 17 14:45:25.481952 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: pcre jit disabled Aug 17 14:45:25.481952 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: detected number of CPU cores: 4 Aug 17 14:45:25.481952 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: current working directory: / Aug 17 14:45:25.481952 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: detected binary path: /usr/bin/uwsgi-core Aug 17 14:45:25.481952 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: your processes number limit is 47680 Aug 17 14:45:25.482630 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: your memory page size is 4096 bytes Aug 17 14:45:25.482630 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: detected max file descriptor number: 2048 Aug 17 14:45:25.482630 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: lock engine: pthread robust mutexes Aug 17 14:45:25.482630 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: thunder lock: enabled Aug 17 14:45:25.482630 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 17 14:45:25.482630 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 14:45:25.528582 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: Python main interpreter initialized at 0x5635f28a89c0 Aug 17 14:45:25.528582 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: python threads support enabled Aug 17 14:45:25.528582 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: your server socket listen backlog is limited to 100 connections Aug 17 14:45:25.528582 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: your mercy for graceful operations on workers is 90 seconds Aug 17 14:45:25.528953 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 14:45:25.529034 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: *** Operational MODE: preforking *** Aug 17 14:45:25.529259 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: *** uWSGI is running in multiple interpreter mode *** Aug 17 14:45:25.529259 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: spawned uWSGI master process (pid: 88144) Aug 17 14:45:25.529467 dv-osbrick-853500-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 17 14:45:25.530358 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: spawned uWSGI worker 1 (pid: 88156, cores: 1) Aug 17 14:45:25.530451 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: spawned uWSGI worker 2 (pid: 88157, cores: 1) Aug 17 14:45:25.533859 dv-osbrick-853500-1-ceph devstack@keystone.service[88144]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 14:45:30.186505 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 14:45:30.186505 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: from cryptography.utils import int_from_bytes Aug 17 14:45:30.187334 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 14:45:30.187334 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: from cryptography.utils import int_from_bytes Aug 17 14:45:30.187922 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 14:45:30.187922 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: from cryptography.utils import int_from_bytes Aug 17 14:45:30.188366 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 14:45:30.188366 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: from cryptography.utils import int_from_bytes Aug 17 14:45:30.237250 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 14:45:30.237429 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 14:45:30.237617 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] command line args: [] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 14:45:30.237909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 14:45:30.238087 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ================================================================================ {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 14:45:30.238341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] admin_token = **** {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.238585 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] config_dir = [] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.238772 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.238952 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] config_source = [] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.239034 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 14:45:30.239131 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] debug = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.239216 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 14:45:30.239329 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.239598 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] command line args: [] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 14:45:30.239598 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 14:45:30.239713 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.239779 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ================================================================================ {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 14:45:30.239915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.240022 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] admin_token = **** {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.240133 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.240228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] config_dir = [] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.240352 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.240502 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.240615 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] config_source = [] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.240716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] list_limit = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.240816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] debug = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.240919 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] log_config_append = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.241024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.241156 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.241156 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] log_dir = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.241331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.241430 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] log_file = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.241530 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.241653 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.241749 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.241866 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.241939 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.242065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.242145 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] list_limit = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.242145 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] log_config_append = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.242288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.242366 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.242436 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.242502 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] log_dir = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.242579 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.242651 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] log_file = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.242772 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.242887 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.243001 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.243108 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.243249 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.243347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.243429 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.243592 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.243679 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.243806 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.243932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.244051 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.244165 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.244276 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.244421 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.244537 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.244666 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.244781 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.244901 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.245018 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.245132 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.245254 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] publish_errors = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.245374 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.245493 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.245612 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.245724 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.245970 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.246077 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.246446 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.246569 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.246569 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.246786 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.246907 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] standard_threads = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.247026 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] publish_errors = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.247140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.247267 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.247391 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.247511 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.247623 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.247807 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.248456 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] use_journal = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.248456 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] use_json = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.248674 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.248800 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] use_stderr = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.248800 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] use_syslog = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.249105 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.249275 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.249275 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.249503 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] standard_threads = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.249616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.249750 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.249750 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.250072 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.250190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.250302 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.250420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] use_journal = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.250533 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.250644 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] use_json = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.250644 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] use_stderr = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.250864 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.250975 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] use_syslog = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.251086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.251197 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:45:30.251308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.251429 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.251526 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.251619 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.251718 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.251813 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.251913 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.252016 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.252112 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.252212 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.252313 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.252408 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.252520 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.252643 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.252756 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.252889 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.252996 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.253115 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.253233 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.253355 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.253473 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.253587 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.253698 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.253827 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.253939 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.254063 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.254177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.254288 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.254399 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.254522 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.254641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.254831 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.254952 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.255071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.255183 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.255294 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.255414 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.255535 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.255654 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.255766 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.255884 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.255996 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.256119 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.256232 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.256343 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.256453 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.256565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.256682 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.256794 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.256905 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.257023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.257135 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.257247 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.257358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.257476 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.257588 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.257700 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.257833 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.257946 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.258066 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.258189 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.258305 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.258422 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.258538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.258650 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.258763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.258883 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.258995 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.259107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.259224 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.259337 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.259448 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.259570 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.259570 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.259786 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.259786 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.260001 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.260114 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.260306 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.260421 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.260531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.260643 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.260755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.260873 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.261001 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.261120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.261233 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.261347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.261458 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.261569 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.261688 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.261824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.261939 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.262050 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.262168 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.262279 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.262399 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.262518 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.262631 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.262742 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.262854 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.262970 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.263091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.263203 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.263315 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.263525 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.263710 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.263865 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.263984 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.264098 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.264210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.264335 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.264450 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.264563 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.264684 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.264804 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.264924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.264924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.265138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.265261 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.265261 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.265488 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.265602 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.265715 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.265895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.266009 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.266133 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.266260 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.266375 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.266496 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.266610 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.266722 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.266833 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.266953 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.267074 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.267188 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.267313 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.267434 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.267548 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.267668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.267774 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.267884 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.267996 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.268108 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.268220 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.268339 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.268457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.268571 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.268674 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.268784 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.268903 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.269024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.269138 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.269251 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.269363 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.269481 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.269595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.269715 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.269845 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.269958 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.270070 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.270182 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.270295 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.270422 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.270537 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.270650 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.270768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.270881 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.270999 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.271121 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.271235 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.271347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.271459 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.271571 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.271682 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.271868 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.271983 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.272095 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.272207 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.272320 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.272445 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.272567 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.272690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.272809 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.272923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.273035 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.273147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.273259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.273380 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.273494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.273606 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.273725 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.273888 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] auth.external = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.274002 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.274127 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.274249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.274363 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.274478 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.274590 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.274708 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.274831 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] auth.password = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.274945 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.275057 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] auth.token = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.275177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.275292 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.275410 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.275564 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.275688 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.275688 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.275917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.276031 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] auth.external = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.276144 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.276257 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.276370 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.276370 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.276597 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.276712 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.276825 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.276825 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] auth.password = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.277039 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] credential.caching = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.277161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] auth.token = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.277276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.277390 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.277503 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.277626 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.277758 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.277886 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.278009 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.278123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.278236 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.278349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.278465 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.278589 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.278704 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.278818 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.278931 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.279112 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] credential.caching = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.279231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.279231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.279457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.279457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.279672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.279785 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.279898 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.280020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.280134 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.280247 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.280360 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.280473 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.280837 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.280837 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] federation.caching = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.281043 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.281139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.281139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.281334 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.281447 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.281568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.281684 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.281830 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.281945 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.282059 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.282184 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.282309 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.282425 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.282539 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.282653 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.282765 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.282888 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.283003 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.283117 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.283231 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] federation.caching = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.283344 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.283457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.283579 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] identity.caching = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.283694 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.283807 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.283920 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.284033 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.284146 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.284267 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.284382 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.284496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.284609 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.284721 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.284835 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.284958 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.285073 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.285187 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.285290 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.285385 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.285479 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.285670 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.285805 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.285922 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.286035 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] identity.caching = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.286148 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.286262 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.286387 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.286502 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.286616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.286616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.286834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.286949 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.287072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.287187 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.287301 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.287414 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.287524 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.287638 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.287760 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.287874 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.287988 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.288102 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.288216 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.288329 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.288454 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.288576 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.288691 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.288804 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.288917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.289031 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.289153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.289268 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.289382 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.289495 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.289608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.289721 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.289898 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.290015 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.290129 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.290243 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.290355 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.290468 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.290589 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.290704 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.290818 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.290931 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.291044 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.291157 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.291282 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.291398 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.291517 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.291631 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.291744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.291858 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.291979 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.292094 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.292206 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.292320 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.292320 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.292540 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.292540 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.292763 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.292763 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.292976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.293088 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.293209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.293209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.293423 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.293423 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.293642 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.293784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.293910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.294026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.294138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.294138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.294351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.294464 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.295097 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.295219 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.295334 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.295448 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.295576 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.295741 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.295877 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.user = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.295995 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.296109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.296223 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.296337 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.296452 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.296574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.296690 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.296810 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.296925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.297046 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.297046 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.297269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.297390 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.297507 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.297626 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.297794 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.297922 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.298048 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.298164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.298312 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.298425 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.298539 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.298652 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.298773 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.user = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.298892 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.299006 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.299119 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.299231 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.299344 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.299465 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.299580 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.299693 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.299806 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.299919 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.300033 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.300154 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.300269 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.300382 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.300495 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.300615 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.300729 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.300851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.300966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.301079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.301192 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.301305 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.301418 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.301540 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.301657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.301786 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.301901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.302015 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.302128 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.302274 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.302392 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.302506 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.302619 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.302733 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.302846 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.302967 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.303083 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.303196 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.303315 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.303430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.303544 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.303665 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.303781 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.303894 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.304007 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.304120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.304234 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.304355 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.304470 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] resource.caching = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.304583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.304696 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.304811 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.304924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.304924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.305148 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.305148 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.305368 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.305527 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.305643 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.305797 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.305916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.306028 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.306140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.306251 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.306363 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.306483 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.306597 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.306708 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.306819 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] role.caching = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.306931 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.307043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] role.driver = sql {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.307163 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.307278 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.307390 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] resource.caching = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.307503 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.307614 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.307735 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.307849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.307962 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.308073 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.308191 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.308305 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.308490 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.308606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.308718 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.308834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.308947 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.309059 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.309180 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.309294 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.309406 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.309518 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.309630 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.309760 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] role.caching = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.309887 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.310002 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] role.driver = sql {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.310115 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.310275 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.310900 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.311016 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.311138 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.311253 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.311377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.311545 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.311688 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.311803 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.311925 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.312040 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.312040 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.312253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.312366 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.312478 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.312478 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.312701 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.312701 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.312912 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.312912 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.313123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.313246 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.313246 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.313458 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.313577 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.313691 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.313825 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.313952 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.314068 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.314068 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.314279 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.314392 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.314512 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.314626 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.314738 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.314851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.314962 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.315074 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.315194 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.315308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] token.caching = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.315420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.315532 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.315644 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.315756 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.315875 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.315989 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.316100 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.316213 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.316325 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.316437 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.316557 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.316670 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.316782 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.316895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.317006 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.317119 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.317239 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.317353 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.317465 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.317577 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.317689 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.317852 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.317978 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.318093 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.318205 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.318317 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.318429 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.318541 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.318661 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] token.caching = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.318766 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.318882 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.318994 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.319106 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.319218 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.319338 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.319452 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] database.connection = **** {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.319573 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.319696 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.319810 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.319923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.320034 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.320154 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.320268 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.320380 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.320492 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.320605 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.320717 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.320837 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.320951 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.321064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.321175 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.321287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.321397 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.321518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.321632 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.321798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.321914 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.322026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.322137 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.322265 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.322380 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.322493 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.322605 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.322717 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.322828 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] database.connection = **** {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.322953 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.323075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.323198 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.323311 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.323424 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.323535 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.323646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.323646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 14:45:30.323866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.323866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.323866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.323866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.323866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.323866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.323866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.323866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.323866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.324771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.324771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.324771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.324771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.324771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.325331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:45:30.325331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 14:45:30.350636 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.350863 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.351086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.353441 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.353674 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.353936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.360386 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.363237 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.390511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.390729 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.392271 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.392502 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.444710 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.445503 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.493483 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.493712 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.494265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.494501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.564758 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.565012 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.565434 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.565651 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.565894 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.566111 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.567471 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.567707 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.567932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.568154 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.568371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.568584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.589977 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.590168 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.590301 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.590429 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.590557 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.590705 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.590835 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.590962 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.591090 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.591217 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.591356 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.591533 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.591664 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.591929 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.602587 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.602736 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.615108 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.615341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.615611 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.615788 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.615876 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.616024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.616111 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.616245 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.616327 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.616460 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.616543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.616675 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.616890 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.617104 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:45:30.633777 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.633985 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 14:45:30.634140 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.634326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.634526 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 14:45:30.634632 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 14:45:30.634803 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.634977 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.635068 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.635174 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 14:45:30.635313 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.635444 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.635571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.635704 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.635959 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.636216 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.645635 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.645937 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.646211 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.646492 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.646708 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.646988 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.647261 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.647544 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.653428 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.654853 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.656596 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.656881 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.657160 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.657446 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.657748 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.657831 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.658009 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.658090 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.658279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.658375 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.658552 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.658633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.658835 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.658988 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.659076 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.659152 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.659342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.659424 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.659612 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.659895 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.660152 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.660419 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.683708 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.684989 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.685160 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.685990 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.687315 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.687602 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.690501 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.690787 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.691177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.692136 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.692426 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.692819 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.697610 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.697879 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.699216 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.699503 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.702598 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.702870 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.703154 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.703562 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.703856 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.704137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.704417 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.704538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.704698 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.704832 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.705114 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.705505 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.705816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.706107 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.706394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.706670 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.720494 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.720772 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.722609 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.722889 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.724624 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.726772 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.727811 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.728220 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.729883 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.730307 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.732477 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.734808 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.735797 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.738204 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.738908 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.739208 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.739493 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.739897 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.740184 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.740475 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.741289 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.741588 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.741896 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.742308 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.742595 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.742876 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.757261 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.757546 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.757869 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.758137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.760312 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.760644 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.760968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.761268 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.765400 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.767077 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.767355 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.768959 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.770030 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.770316 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.770597 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.770734 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.770887 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.770974 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.771183 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.773508 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.773815 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.774098 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.774397 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.774683 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.782679 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.782967 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.783246 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.783525 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.783815 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.784090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.784365 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.786314 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.786601 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.786885 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.787171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.787466 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.787739 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.788011 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.799888 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.802804 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.803684 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.805820 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.806604 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.807244 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.808716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.809000 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.809283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.809596 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.811889 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.813360 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.813645 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.813958 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.816260 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.817714 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.820391 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.820595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.820890 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.821174 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.821450 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.821860 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.824725 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.825014 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.825296 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.825569 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.831028 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.831321 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.831603 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.835399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.835693 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.835976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.838360 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.838746 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.839028 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.839307 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.839586 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.839858 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.840130 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.840396 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.840673 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.840949 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.841235 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.841534 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.841837 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.842095 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.843408 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:45:30.843792 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.844075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.844354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.844640 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.844917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.845194 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.845468 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.845767 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.846053 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.846333 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.846595 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.846867 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.847146 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:45:30.876002 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5635f28a89c0 pid: 88157 (default app) Aug 17 14:45:30.879424 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d002b-c478-4a56-913d-85a54522c319 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:30.879709 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d002b-c478-4a56-913d-85a54522c319 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:30.879980 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d002b-c478-4a56-913d-85a54522c319 None None] PATH_INFO: `/v3` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:30.881404 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5635f28a89c0 pid: 88156 (default app) Aug 17 14:45:30.884101 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Wed Aug 17 14:45:30 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:45:38.005788 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75e8a8-4080-4f41-8007-6b528c5b4701 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:38.006295 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75e8a8-4080-4f41-8007-6b528c5b4701 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:38.006377 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75e8a8-4080-4f41-8007-6b528c5b4701 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:38.010894 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:45:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:45:38.016608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21594d8-4b4a-485a-a482-fb518e47420d None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:38.017000 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21594d8-4b4a-485a-a482-fb518e47420d None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:38.017156 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21594d8-4b4a-485a-a482-fb518e47420d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:38.096926 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: INFO dbcounter [None req-b21594d8-4b4a-485a-a482-fb518e47420d None None] Registered counter for database keystone Aug 17 14:45:38.116754 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG oslo_db.sqlalchemy.engines [None req-b21594d8-4b4a-485a-a482-fb518e47420d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 14:45:38.123974 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writer thread running {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 14:45:38.303265 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG passlib.handlers.bcrypt [None req-b21594d8-4b4a-485a-a482-fb518e47420d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88157) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 14:45:38.303603 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG passlib.handlers.bcrypt [None req-b21594d8-4b4a-485a-a482-fb518e47420d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88157) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 14:45:38.358007 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-b21594d8-4b4a-485a-a482-fb518e47420d None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:45:38.359632 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-b21594d8-4b4a-485a-a482-fb518e47420d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:45:38.488080 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:45:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 17 14:45:38.995298 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75e8a8-4080-4f41-8007-6b528c5b4701 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:39.072407 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: INFO dbcounter [None req-5b75e8a8-4080-4f41-8007-6b528c5b4701 None None] Registered counter for database keystone Aug 17 14:45:39.094851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG oslo_db.sqlalchemy.engines [None req-5b75e8a8-4080-4f41-8007-6b528c5b4701 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 14:45:39.101374 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writer thread running {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 14:45:39.222551 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75e8a8-4080-4f41-8007-6b528c5b4701 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:39.226826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e187eb-26e0-4ef2-aa04-0acf65675f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:39.227452 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e187eb-26e0-4ef2-aa04-0acf65675f64 admin admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:39.227731 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e187eb-26e0-4ef2-aa04-0acf65675f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:39.228005 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e187eb-26e0-4ef2-aa04-0acf65675f64 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:39.236642 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e187eb-26e0-4ef2-aa04-0acf65675f64 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:39.288262 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a6e187eb-26e0-4ef2-aa04-0acf65675f64 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 14:45:39.288551 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e187eb-26e0-4ef2-aa04-0acf65675f64 admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:39.298634 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Aug 17 14:45:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 14:45:39.304595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21594d8-4b4a-485a-a482-fb518e47420d None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:39.321667 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21594d8-4b4a-485a-a482-fb518e47420d None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:39.326112 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05800c73-224c-4039-a166-6f8db71a7933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:39.327239 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05800c73-224c-4039-a166-6f8db71a7933 admin admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:39.327520 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05800c73-224c-4039-a166-6f8db71a7933 admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:39.327794 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05800c73-224c-4039-a166-6f8db71a7933 admin admin] PATH_INFO: `/v3/projects/09a5e42d9b6e4e598b40571f10c289e0` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:39.329249 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05800c73-224c-4039-a166-6f8db71a7933 admin admin] RBAC: Authorizing `identity:get_project(project_id=09a5e42d9b6e4e598b40571f10c289e0)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:39.380249 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: WARNING keystone.common.rbac_enforcer.enforcer [None req-05800c73-224c-4039-a166-6f8db71a7933 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 14:45:39.380587 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05800c73-224c-4039-a166-6f8db71a7933 admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:39.385116 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 3/5] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Aug 17 14:45:39 2022] GET /identity/v3/projects/09a5e42d9b6e4e598b40571f10c289e0 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:45:41.533543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eef98c-13f1-4199-b0a8-a1edb62dd231 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:41.534185 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eef98c-13f1-4199-b0a8-a1edb62dd231 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:41.534185 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eef98c-13f1-4199-b0a8-a1edb62dd231 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:41.538278 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 3/6] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:45:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:45:41.543754 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23724bd-2b64-4f64-a3f2-7d0d5f9eb247 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:41.544143 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23724bd-2b64-4f64-a3f2-7d0d5f9eb247 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:41.544306 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23724bd-2b64-4f64-a3f2-7d0d5f9eb247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:41.564456 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-a23724bd-2b64-4f64-a3f2-7d0d5f9eb247 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:45:41.566020 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-a23724bd-2b64-4f64-a3f2-7d0d5f9eb247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:45:41.573795 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:45:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 17 14:45:41.900534 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eef98c-13f1-4199-b0a8-a1edb62dd231 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:41.913104 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eef98c-13f1-4199-b0a8-a1edb62dd231 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:41.917271 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e7100-a5b0-486a-8d6b-b15031267f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:41.917891 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e7100-a5b0-486a-8d6b-b15031267f7a admin admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:41.918177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e7100-a5b0-486a-8d6b-b15031267f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:41.918449 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e7100-a5b0-486a-8d6b-b15031267f7a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:41.926332 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e7100-a5b0-486a-8d6b-b15031267f7a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:41.928085 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e7100-a5b0-486a-8d6b-b15031267f7a admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:41.937405 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Aug 17 14:45:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 14:45:41.942983 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23724bd-2b64-4f64-a3f2-7d0d5f9eb247 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:41.952908 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23724bd-2b64-4f64-a3f2-7d0d5f9eb247 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:41.957221 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59404e8b-1890-4faf-a846-2f2292ae3953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:41.957864 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59404e8b-1890-4faf-a846-2f2292ae3953 admin admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:41.958145 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59404e8b-1890-4faf-a846-2f2292ae3953 admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:41.958415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59404e8b-1890-4faf-a846-2f2292ae3953 admin admin] PATH_INFO: `/v3/users/4b2dd9ba613b47b8b4618c0c2e6e4e48` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:41.959714 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59404e8b-1890-4faf-a846-2f2292ae3953 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b2dd9ba613b47b8b4618c0c2e6e4e48)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:41.961522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59404e8b-1890-4faf-a846-2f2292ae3953 admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:41.963055 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 5/9] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Aug 17 14:45:41 2022] GET /identity/v3/users/4b2dd9ba613b47b8b4618c0c2e6e4e48 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:45:44.221569 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f05795-6cab-4b91-85bc-876cf75ea83d None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:44.222151 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f05795-6cab-4b91-85bc-876cf75ea83d None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:44.222151 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f05795-6cab-4b91-85bc-876cf75ea83d None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:44.223468 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:45:44.228472 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd73168-219c-4c79-8cfb-ede1b100c595 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:44.228895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd73168-219c-4c79-8cfb-ede1b100c595 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:44.229044 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd73168-219c-4c79-8cfb-ede1b100c595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:44.247809 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-1dd73168-219c-4c79-8cfb-ede1b100c595 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:45:44.249240 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-1dd73168-219c-4c79-8cfb-ede1b100c595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:45:44.273568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860461f-005f-4198-b754-abff101df10f None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:44.273884 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860461f-005f-4198-b754-abff101df10f None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:44.274166 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860461f-005f-4198-b754-abff101df10f None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:44.275480 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 6/11] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:45:44.281157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdec793-3949-4794-9a1d-045c9f9c5f96 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:44.281505 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdec793-3949-4794-9a1d-045c9f9c5f96 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:44.281803 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdec793-3949-4794-9a1d-045c9f9c5f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:44.326315 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG passlib.handlers.bcrypt [None req-5fdec793-3949-4794-9a1d-045c9f9c5f96 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88156) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 14:45:44.327361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG passlib.handlers.bcrypt [None req-5fdec793-3949-4794-9a1d-045c9f9c5f96 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88156) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 14:45:44.374417 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-5fdec793-3949-4794-9a1d-045c9f9c5f96 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:45:44.376060 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-5fdec793-3949-4794-9a1d-045c9f9c5f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:45:44.447184 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:45:44.479461 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:45:44.772803 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd73168-219c-4c79-8cfb-ede1b100c595 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:44.798110 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:44.803066 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdec793-3949-4794-9a1d-045c9f9c5f96 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:44.881778 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd73168-219c-4c79-8cfb-ede1b100c595 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:44.903415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdec793-3949-4794-9a1d-045c9f9c5f96 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:44.906612 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:44.915915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cb461-701c-4bc3-8107-a247501b760d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:44.916795 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cb461-701c-4bc3-8107-a247501b760d None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:44.917080 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cb461-701c-4bc3-8107-a247501b760d None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:44.917362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cb461-701c-4bc3-8107-a247501b760d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:44.929882 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163cb461-701c-4bc3-8107-a247501b760d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:45:44.938677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-163cb461-701c-4bc3-8107-a247501b760d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:45:44.938677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:45:44.938677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:45:44.938677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:45:44.938677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:45:44.938677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:45:44.938677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:45:44.938677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:45:44.938677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:45:44.938677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:45:44.938677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:45:44.938677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:45:44.938677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:45:44.938677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:45:44.938677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:45:44.938677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:45:44.939798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:45:44.939798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:45:44.939798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:45:44.939798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:45:44.939798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:45:44.939798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:45:44.939798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:45:44.939798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:45:44.939798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:45:44.939798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:45:44.939798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:45:44.939798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:45:44.939798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:45:44.939798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:45:44.939798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:45:44.939798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:45:44.940818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:45:44.940818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:45:44.940818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:45:44.940818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:45:44.940818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:45:44.940818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:45:44.940818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:45:44.940818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:45:44.940818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:45:44.940818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:45:44.940818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:45:44.940818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:45:44.940818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 7/14] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 17 14:45:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:45:44.944017 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6eb775-f382-4ec0-baa2-1d6422944bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:44.944876 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6eb775-f382-4ec0-baa2-1d6422944bb3 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:44.945156 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6eb775-f382-4ec0-baa2-1d6422944bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:44.945431 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6eb775-f382-4ec0-baa2-1d6422944bb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:44.945615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cb461-701c-4bc3-8107-a247501b760d None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:45.013091 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6eb775-f382-4ec0-baa2-1d6422944bb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:45.014776 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6eb775-f382-4ec0-baa2-1d6422944bb3 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:45.026137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:45.047120 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cb461-701c-4bc3-8107-a247501b760d None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:45.081853 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8efe16-6c82-432c-832d-55f4a7d3ee7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:45.082458 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8efe16-6c82-432c-832d-55f4a7d3ee7f None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:45.082736 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8efe16-6c82-432c-832d-55f4a7d3ee7f None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:45.083009 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8efe16-6c82-432c-832d-55f4a7d3ee7f None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:45.083679 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8efe16-6c82-432c-832d-55f4a7d3ee7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:45:45.083980 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8efe16-6c82-432c-832d-55f4a7d3ee7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:45.085362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8efe16-6c82-432c-832d-55f4a7d3ee7f None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:45.097414 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 8/15] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:45:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:45:45.103161 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8efe16-6c82-432c-832d-55f4a7d3ee7f None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:45.112429 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 8/16] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:45:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:45:45.117844 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6eb775-f382-4ec0-baa2-1d6422944bb3 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:45.120510 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:45.203863 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8efe16-6c82-432c-832d-55f4a7d3ee7f None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:45.215909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6eb775-f382-4ec0-baa2-1d6422944bb3 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:45.239235 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627320e-e3ec-49e0-813c-59ba9e06b3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:45.239871 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627320e-e3ec-49e0-813c-59ba9e06b3bb None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:45.240154 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627320e-e3ec-49e0-813c-59ba9e06b3bb None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:45.240430 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627320e-e3ec-49e0-813c-59ba9e06b3bb None admin] PATH_INFO: `/v3/users/4b2dd9ba613b47b8b4618c0c2e6e4e48` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:45.241586 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627320e-e3ec-49e0-813c-59ba9e06b3bb None admin] RBAC: Authorizing `identity:get_user(user_id=4b2dd9ba613b47b8b4618c0c2e6e4e48)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:45.243075 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627320e-e3ec-49e0-813c-59ba9e06b3bb None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:45.244631 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 9/17] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:45:45 2022] GET /identity/v3/users/4b2dd9ba613b47b8b4618c0c2e6e4e48 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:45:45.249856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be28635-fa3f-438d-9c87-1b9be3fdaff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:45.250490 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627320e-e3ec-49e0-813c-59ba9e06b3bb None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:45.250706 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be28635-fa3f-438d-9c87-1b9be3fdaff8 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:45.250989 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be28635-fa3f-438d-9c87-1b9be3fdaff8 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:45.251262 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be28635-fa3f-438d-9c87-1b9be3fdaff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:45.265210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:45.270057 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be28635-fa3f-438d-9c87-1b9be3fdaff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:45.271507 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be28635-fa3f-438d-9c87-1b9be3fdaff8 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:45.290855 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-0be28635-fa3f-438d-9c87-1b9be3fdaff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:45:45.290855 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:45:45.290855 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:45:45.290855 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:45:45.290855 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:45:45.290855 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:45:45.290855 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:45:45.290855 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:45:45.290855 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:45:45.290855 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:45:45.290855 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:45:45.290855 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:45:45.290855 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:45:45.290855 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:45:45.290855 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:45:45.290855 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:45:45.291732 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:45:45.291732 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:45:45.291732 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:45:45.291732 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:45:45.291732 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:45:45.291732 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:45:45.291732 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:45:45.291732 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:45:45.291732 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:45:45.291732 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:45:45.291732 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:45:45.291732 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:45:45.291732 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:45:45.291732 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:45:45.291732 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:45:45.291732 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:45:45.291732 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:45:45.292541 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:45:45.292541 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:45:45.292541 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:45:45.292541 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 9/18] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:45:45.298179 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be28635-fa3f-438d-9c87-1b9be3fdaff8 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:45.355439 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627320e-e3ec-49e0-813c-59ba9e06b3bb None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:45.393355 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce784b-3154-4ce4-9200-148438e13cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:45.394037 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce784b-3154-4ce4-9200-148438e13cd1 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:45.394315 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce784b-3154-4ce4-9200-148438e13cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:45.394582 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce784b-3154-4ce4-9200-148438e13cd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:45.395879 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce784b-3154-4ce4-9200-148438e13cd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:45.397387 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce784b-3154-4ce4-9200-148438e13cd1 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:45.399101 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 10/19] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:45:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:45:45.404939 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce784b-3154-4ce4-9200-148438e13cd1 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:45.472408 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:45.492251 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:45.513683 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce784b-3154-4ce4-9200-148438e13cd1 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:45.518085 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be28635-fa3f-438d-9c87-1b9be3fdaff8 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:45.549410 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643d3ce-c1b6-4aa7-a323-65384deeb754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:45.549981 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643d3ce-c1b6-4aa7-a323-65384deeb754 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:45.550267 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643d3ce-c1b6-4aa7-a323-65384deeb754 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:45.550573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643d3ce-c1b6-4aa7-a323-65384deeb754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:45.551273 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643d3ce-c1b6-4aa7-a323-65384deeb754 None admin] RBAC: Adding query filter params (role.id=a307f157f2a445c7af8bd4fd41aa1c4b, scope.domain.id=default, user.id=4b2dd9ba613b47b8b4618c0c2e6e4e48) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:45:45.551584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643d3ce-c1b6-4aa7-a323-65384deeb754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:45.551675 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff1589-e9de-4752-9e2f-446e03b2519c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:45.552238 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff1589-e9de-4752-9e2f-446e03b2519c None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:45.553006 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff1589-e9de-4752-9e2f-446e03b2519c None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:45.553084 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643d3ce-c1b6-4aa7-a323-65384deeb754 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:45.553274 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff1589-e9de-4752-9e2f-446e03b2519c None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:45.553954 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff1589-e9de-4752-9e2f-446e03b2519c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:45:45.554255 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff1589-e9de-4752-9e2f-446e03b2519c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:45.555622 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff1589-e9de-4752-9e2f-446e03b2519c None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:45.560791 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 11/20] 10.222.0.30 () {56 vars in 1322 bytes} [Wed Aug 17 14:45:45 2022] GET /identity/v3/role_assignments?user.id=4b2dd9ba613b47b8b4618c0c2e6e4e48&scope.domain.id=default&role.id=a307f157f2a445c7af8bd4fd41aa1c4b => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:45:45.574237 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 10/21] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:45:48.065152 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d9344-955a-45c2-8253-9d96f5433ba9 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:48.065152 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d9344-955a-45c2-8253-9d96f5433ba9 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:48.065152 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d9344-955a-45c2-8253-9d96f5433ba9 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:48.065152 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 12/22] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:45:48.070871 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5b21f-944e-4dc6-b27d-0af6b0d514c7 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:48.071989 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5b21f-944e-4dc6-b27d-0af6b0d514c7 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:48.072715 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5b21f-944e-4dc6-b27d-0af6b0d514c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:48.103067 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-caa5b21f-944e-4dc6-b27d-0af6b0d514c7 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:45:48.104606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-caa5b21f-944e-4dc6-b27d-0af6b0d514c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:45:48.190741 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 11/23] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:45:48.272180 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35176463-c125-4cc9-9bcb-59bd8ffbcd54 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:48.272829 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35176463-c125-4cc9-9bcb-59bd8ffbcd54 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:48.273307 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35176463-c125-4cc9-9bcb-59bd8ffbcd54 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:48.274871 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:45:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:45:48.279954 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c32c2-6557-4fb2-a894-3b29a69391b3 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:48.280472 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c32c2-6557-4fb2-a894-3b29a69391b3 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:48.280961 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c32c2-6557-4fb2-a894-3b29a69391b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:48.310323 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-3f7c32c2-6557-4fb2-a894-3b29a69391b3 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:45:48.311925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-3f7c32c2-6557-4fb2-a894-3b29a69391b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:45:48.367258 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbd88a-7e20-4fd7-8580-f2c18b362ee6 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:48.367864 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbd88a-7e20-4fd7-8580-f2c18b362ee6 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:48.367980 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:48.368445 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbd88a-7e20-4fd7-8580-f2c18b362ee6 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:48.370004 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 14/25] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:45:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:45:48.379380 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e96d95-b4d3-4159-ad4d-3cdcbd13e0ec None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:48.379955 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e96d95-b4d3-4159-ad4d-3cdcbd13e0ec None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:48.380441 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e96d95-b4d3-4159-ad4d-3cdcbd13e0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:48.404990 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 12/26] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:45:48.437652 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-a8e96d95-b4d3-4159-ad4d-3cdcbd13e0ec None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:45:48.439211 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-a8e96d95-b4d3-4159-ad4d-3cdcbd13e0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:45:48.579471 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 15/27] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 17 14:45:48.699546 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c32c2-6557-4fb2-a894-3b29a69391b3 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:48.822500 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c32c2-6557-4fb2-a894-3b29a69391b3 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:48.859272 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119e0c6-27f0-4db3-9ad3-9832ee125cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:48.859910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119e0c6-27f0-4db3-9ad3-9832ee125cb5 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:48.860190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119e0c6-27f0-4db3-9ad3-9832ee125cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:48.860465 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119e0c6-27f0-4db3-9ad3-9832ee125cb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:48.872407 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119e0c6-27f0-4db3-9ad3-9832ee125cb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:45:48.879577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-1119e0c6-27f0-4db3-9ad3-9832ee125cb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:45:48.879577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:45:48.879577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:45:48.879577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:45:48.879577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:45:48.879577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:45:48.879577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:45:48.879577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:45:48.879577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:45:48.879577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:45:48.879577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:45:48.879577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:45:48.879577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:45:48.879577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:45:48.879577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:45:48.879577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:45:48.880440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:45:48.880440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:45:48.880440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:45:48.880440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:45:48.880440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:45:48.880440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:45:48.880440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:45:48.880440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:45:48.880440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:45:48.880440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:45:48.880440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:45:48.880440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:45:48.880440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:45:48.880440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:45:48.880440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:45:48.880440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:45:48.881177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:45:48.881177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:45:48.881177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:45:48.881177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:45:48.881177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:45:48.881177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:45:48.881177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:45:48.881177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:45:48.881177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:45:48.881177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:45:48.881177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:45:48.881177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:45:48.881177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 13/28] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 17 14:45:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:45:48.887957 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e96d95-b4d3-4159-ad4d-3cdcbd13e0ec None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:48.954550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119e0c6-27f0-4db3-9ad3-9832ee125cb5 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:49.025756 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:49.025944 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:49.069073 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e96d95-b4d3-4159-ad4d-3cdcbd13e0ec None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:49.109488 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119e0c6-27f0-4db3-9ad3-9832ee125cb5 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:49.144356 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb33869-801d-4cad-9973-02a586f0b2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:49.145009 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb33869-801d-4cad-9973-02a586f0b2dd None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:49.145291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb33869-801d-4cad-9973-02a586f0b2dd None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:49.145579 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb33869-801d-4cad-9973-02a586f0b2dd None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:49.149770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb33869-801d-4cad-9973-02a586f0b2dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:45:49.149770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb33869-801d-4cad-9973-02a586f0b2dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:49.149770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb33869-801d-4cad-9973-02a586f0b2dd None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:49.169457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 16/29] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:45:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:45:49.173827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb33869-801d-4cad-9973-02a586f0b2dd None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:49.182292 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f3098-a96f-4c51-98b5-e9bf610c249b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:49.182928 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f3098-a96f-4c51-98b5-e9bf610c249b None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:49.183211 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f3098-a96f-4c51-98b5-e9bf610c249b None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:49.183486 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f3098-a96f-4c51-98b5-e9bf610c249b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:49.210093 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f3098-a96f-4c51-98b5-e9bf610c249b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:49.211498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f3098-a96f-4c51-98b5-e9bf610c249b None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:49.236812 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-cb5f3098-a96f-4c51-98b5-e9bf610c249b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:45:49.236812 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:45:49.236812 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:45:49.236812 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:45:49.236812 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:45:49.236812 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:45:49.236812 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:45:49.236812 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:45:49.236812 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:45:49.236812 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:45:49.236812 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:45:49.236812 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:45:49.236812 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:45:49.236812 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:45:49.236812 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:45:49.236812 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:45:49.237777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:45:49.237777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:45:49.237777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:45:49.237777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:45:49.237777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:45:49.237777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:45:49.237777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:45:49.237777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:45:49.237777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:45:49.237777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:45:49.237777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:45:49.237777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:45:49.237777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:45:49.237777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:45:49.237777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:45:49.237777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:45:49.237777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:45:49.238668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:45:49.238668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:45:49.238668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:45:49.247211 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 14/30] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:45:49.248407 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f3098-a96f-4c51-98b5-e9bf610c249b None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:49.325095 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb33869-801d-4cad-9973-02a586f0b2dd None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:49.371996 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6e008-90dd-46e4-b4ac-ecf893486ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:49.373572 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6e008-90dd-46e4-b4ac-ecf893486ea7 None admin] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:49.374006 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6e008-90dd-46e4-b4ac-ecf893486ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:49.374504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6e008-90dd-46e4-b4ac-ecf893486ea7 None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:49.375465 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6e008-90dd-46e4-b4ac-ecf893486ea7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:49.377124 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6e008-90dd-46e4-b4ac-ecf893486ea7 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:49.381040 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:49.387324 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:49.399494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f3098-a96f-4c51-98b5-e9bf610c249b None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:49.442655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a923673-f00b-420e-a85c-27382f7b3688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:49.443324 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a923673-f00b-420e-a85c-27382f7b3688 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:49.443605 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a923673-f00b-420e-a85c-27382f7b3688 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:49.443872 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a923673-f00b-420e-a85c-27382f7b3688 None admin] PATH_INFO: `/v3/users/4b2dd9ba613b47b8b4618c0c2e6e4e48` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:49.445406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a923673-f00b-420e-a85c-27382f7b3688 None admin] RBAC: Authorizing `identity:get_user(user_id=4b2dd9ba613b47b8b4618c0c2e6e4e48)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:49.446857 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a923673-f00b-420e-a85c-27382f7b3688 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:49.448533 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 15/31] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:45:49 2022] GET /identity/v3/users/4b2dd9ba613b47b8b4618c0c2e6e4e48 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:45:49.454071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a923673-f00b-420e-a85c-27382f7b3688 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:49.532581 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 17/32] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Aug 17 14:45:49 2022] POST /identity/v3/roles => generated 219 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:45:49.534600 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c192ecb-7ac9-4444-9656-cdb0095deaef None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:49.535091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c192ecb-7ac9-4444-9656-cdb0095deaef None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:49.535566 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c192ecb-7ac9-4444-9656-cdb0095deaef None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:49.541484 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 18/33] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:45:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:45:49.542833 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c192ecb-7ac9-4444-9656-cdb0095deaef None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:49.573265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a923673-f00b-420e-a85c-27382f7b3688 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:49.622173 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffc997-5847-4fa7-b5ef-b29c22222288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:49.623700 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffc997-5847-4fa7-b5ef-b29c22222288 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:49.624225 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffc997-5847-4fa7-b5ef-b29c22222288 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:49.624709 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffc997-5847-4fa7-b5ef-b29c22222288 None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:49.625659 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffc997-5847-4fa7-b5ef-b29c22222288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:45:49.626284 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffc997-5847-4fa7-b5ef-b29c22222288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:49.628081 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffc997-5847-4fa7-b5ef-b29c22222288 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:49.644049 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 16/34] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:45:49.645949 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15f001-09b3-4f5e-a533-6c43e9a589c4 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:49.646432 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15f001-09b3-4f5e-a533-6c43e9a589c4 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:49.646896 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15f001-09b3-4f5e-a533-6c43e9a589c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:49.668289 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-9f15f001-09b3-4f5e-a533-6c43e9a589c4 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:45:49.670715 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-9f15f001-09b3-4f5e-a533-6c43e9a589c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:45:49.682758 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c192ecb-7ac9-4444-9656-cdb0095deaef None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:49.683377 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:49.750902 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 17/35] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:45:49.758868 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15f001-09b3-4f5e-a533-6c43e9a589c4 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:49.811818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28469787-2a74-49b5-b2b5-4e600e7e499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:49.812460 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28469787-2a74-49b5-b2b5-4e600e7e499b None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:49.812744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28469787-2a74-49b5-b2b5-4e600e7e499b None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:49.813011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28469787-2a74-49b5-b2b5-4e600e7e499b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:49.818475 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28469787-2a74-49b5-b2b5-4e600e7e499b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:49.820051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28469787-2a74-49b5-b2b5-4e600e7e499b None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:49.822063 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 19/36] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:45:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:45:49.828210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28469787-2a74-49b5-b2b5-4e600e7e499b None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:49.881777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15f001-09b3-4f5e-a533-6c43e9a589c4 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:49.918002 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32f671-3513-42ab-8896-03b32970d0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:49.918615 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32f671-3513-42ab-8896-03b32970d0fe None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:49.918947 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32f671-3513-42ab-8896-03b32970d0fe None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:49.919227 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32f671-3513-42ab-8896-03b32970d0fe None admin] PATH_INFO: `/v3/projects` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:49.920505 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32f671-3513-42ab-8896-03b32970d0fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:49.922000 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32f671-3513-42ab-8896-03b32970d0fe None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:49.966785 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:49.968746 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:50.036043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28469787-2a74-49b5-b2b5-4e600e7e499b None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:50.101324 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3256c-2307-4f18-a569-fbe17cdca72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:50.101968 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3256c-2307-4f18-a569-fbe17cdca72e None admin] REQUEST_METHOD: `PUT` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:50.102285 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3256c-2307-4f18-a569-fbe17cdca72e None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:50.102701 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3256c-2307-4f18-a569-fbe17cdca72e None admin] PATH_INFO: `/v3/domains/default/users/4b2dd9ba613b47b8b4618c0c2e6e4e48/roles/a307f157f2a445c7af8bd4fd41aa1c4b` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:50.107046 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3256c-2307-4f18-a569-fbe17cdca72e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4b2dd9ba613b47b8b4618c0c2e6e4e48, role_id=a307f157f2a445c7af8bd4fd41aa1c4b)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:50.109278 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3256c-2307-4f18-a569-fbe17cdca72e None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:50.130852 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 17 14:45:49 2022] POST /identity/v3/projects => generated 301 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:45:50.146111 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 20/38] 10.222.0.30 () {58 vars in 1361 bytes} [Wed Aug 17 14:45:49 2022] PUT /identity/v3/domains/default/users/4b2dd9ba613b47b8b4618c0c2e6e4e48/roles/a307f157f2a445c7af8bd4fd41aa1c4b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:45:50.256822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32f671-3513-42ab-8896-03b32970d0fe None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:50.260712 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64b519-058e-4e4c-9920-91d18b0452ab None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:50.261004 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64b519-058e-4e4c-9920-91d18b0452ab None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:50.261286 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64b519-058e-4e4c-9920-91d18b0452ab None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:50.263137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 21/39] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:45:50.268526 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31e0fd-9f15-46c3-ac12-d31cd75c7a3b None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:50.268814 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31e0fd-9f15-46c3-ac12-d31cd75c7a3b None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:50.269085 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31e0fd-9f15-46c3-ac12-d31cd75c7a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:50.308854 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-cb31e0fd-9f15-46c3-ac12-d31cd75c7a3b None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:45:50.311039 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-cb31e0fd-9f15-46c3-ac12-d31cd75c7a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:45:50.397200 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 22/40] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:45:50.398436 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1d2ed-bfa1-4069-962d-b87e8596c8ef None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:50.398723 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1d2ed-bfa1-4069-962d-b87e8596c8ef None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:50.398991 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1d2ed-bfa1-4069-962d-b87e8596c8ef None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:50.400225 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 23/41] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:45:50.408135 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690451db-d956-4737-b2ed-ce37ebff060d None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:50.408415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690451db-d956-4737-b2ed-ce37ebff060d None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:50.408690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690451db-d956-4737-b2ed-ce37ebff060d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:50.419506 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32f671-3513-42ab-8896-03b32970d0fe None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:50.433340 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-690451db-d956-4737-b2ed-ce37ebff060d None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:45:50.434856 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-690451db-d956-4737-b2ed-ce37ebff060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:45:50.464600 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a00b1-285a-4f57-b6d9-14d75bcb0676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:50.465232 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a00b1-285a-4f57-b6d9-14d75bcb0676 None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:50.465510 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a00b1-285a-4f57-b6d9-14d75bcb0676 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:50.466262 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a00b1-285a-4f57-b6d9-14d75bcb0676 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:50.468341 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a00b1-285a-4f57-b6d9-14d75bcb0676 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:50.470513 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a00b1-285a-4f57-b6d9-14d75bcb0676 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:50.492957 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 19/42] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Aug 17 14:45:50 2022] POST /identity/v3/roles => generated 225 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:45:50.508644 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:50.525039 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 24/43] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:45:50.758615 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a00b1-285a-4f57-b6d9-14d75bcb0676 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:50.818056 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:50.861014 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a00b1-285a-4f57-b6d9-14d75bcb0676 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:50.891969 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690451db-d956-4737-b2ed-ce37ebff060d None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:50.893379 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6d2e8-a88d-42e8-9701-866c75737c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:50.894022 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6d2e8-a88d-42e8-9701-866c75737c2d None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:50.894307 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6d2e8-a88d-42e8-9701-866c75737c2d None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:50.894586 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6d2e8-a88d-42e8-9701-866c75737c2d None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:50.895299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6d2e8-a88d-42e8-9701-866c75737c2d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:50.897051 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6d2e8-a88d-42e8-9701-866c75737c2d None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:50.912346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 20/44] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Aug 17 14:45:50 2022] POST /identity/v3/roles => generated 223 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:45:51.013756 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690451db-d956-4737-b2ed-ce37ebff060d None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:51.052284 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c933d7-707a-490f-8187-87ee3ed34a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:51.052931 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c933d7-707a-490f-8187-87ee3ed34a30 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:51.053209 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c933d7-707a-490f-8187-87ee3ed34a30 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:51.053494 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c933d7-707a-490f-8187-87ee3ed34a30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:51.054722 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c933d7-707a-490f-8187-87ee3ed34a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:51.056219 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c933d7-707a-490f-8187-87ee3ed34a30 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:51.058084 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 25/45] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:45:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:45:51.063838 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6d2e8-a88d-42e8-9701-866c75737c2d None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:51.172226 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6d2e8-a88d-42e8-9701-866c75737c2d None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:51.188817 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:51.206478 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff86157-6690-4f16-9344-ddccff09c612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:51.207078 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff86157-6690-4f16-9344-ddccff09c612 None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:51.207357 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff86157-6690-4f16-9344-ddccff09c612 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:51.207628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff86157-6690-4f16-9344-ddccff09c612 None admin] PATH_INFO: `/v3/projects` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:51.208270 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff86157-6690-4f16-9344-ddccff09c612 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:51.209702 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff86157-6690-4f16-9344-ddccff09c612 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:51.237584 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 21/46] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 17 14:45:51 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:45:52.456820 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e5ac8-6ac7-4958-9522-f93962b6f5ec None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:52.457330 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e5ac8-6ac7-4958-9522-f93962b6f5ec None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:52.457446 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e5ac8-6ac7-4958-9522-f93962b6f5ec None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:52.458716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 26/47] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:45:52.464018 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28b83e-43ee-4385-98d8-d30df04e17a4 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:52.464392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28b83e-43ee-4385-98d8-d30df04e17a4 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:52.464705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28b83e-43ee-4385-98d8-d30df04e17a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:52.484125 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-ac28b83e-43ee-4385-98d8-d30df04e17a4 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:45:52.485642 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-ac28b83e-43ee-4385-98d8-d30df04e17a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:45:52.550942 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 22/48] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:45:52.889135 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e5ac8-6ac7-4958-9522-f93962b6f5ec None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:52.944164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:52.994001 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e5ac8-6ac7-4958-9522-f93962b6f5ec None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:53.029080 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af858dc-1fe1-4f41-8f96-78d0ba502809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:53.029970 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af858dc-1fe1-4f41-8f96-78d0ba502809 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:53.030306 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af858dc-1fe1-4f41-8f96-78d0ba502809 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:53.030636 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af858dc-1fe1-4f41-8f96-78d0ba502809 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:53.040893 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af858dc-1fe1-4f41-8f96-78d0ba502809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:45:53.045932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-9af858dc-1fe1-4f41-8f96-78d0ba502809 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:45:53.045932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:45:53.045932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:45:53.045932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:45:53.045932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:45:53.045932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:45:53.045932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:45:53.045932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:45:53.045932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:45:53.045932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:45:53.045932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:45:53.045932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:45:53.045932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:45:53.045932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:45:53.045932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:45:53.045932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:45:53.046750 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:45:53.046750 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:45:53.046750 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:45:53.046750 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:45:53.046750 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:45:53.046750 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:45:53.046750 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:45:53.046750 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:45:53.046750 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:45:53.046750 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:45:53.046750 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:45:53.046750 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:45:53.046750 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:45:53.046750 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:45:53.046750 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:45:53.046750 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:45:53.047773 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:45:53.047773 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:45:53.047773 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:45:53.047773 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:45:53.047773 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:45:53.047773 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:45:53.047773 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:45:53.047773 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:45:53.047773 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:45:53.047773 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:45:53.047773 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:45:53.047773 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:45:53.047773 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 27/49] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 17 14:45:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:45:53.052847 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28b83e-43ee-4385-98d8-d30df04e17a4 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:53.149230 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:53.152291 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28b83e-43ee-4385-98d8-d30df04e17a4 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:53.187030 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886f4fd-e1a9-4a46-9e5c-aa562aded20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:53.187627 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886f4fd-e1a9-4a46-9e5c-aa562aded20c None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:53.187908 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886f4fd-e1a9-4a46-9e5c-aa562aded20c None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:53.188183 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886f4fd-e1a9-4a46-9e5c-aa562aded20c None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:53.188847 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886f4fd-e1a9-4a46-9e5c-aa562aded20c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:45:53.189149 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886f4fd-e1a9-4a46-9e5c-aa562aded20c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:53.190567 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886f4fd-e1a9-4a46-9e5c-aa562aded20c None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:53.202713 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 23/50] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:45:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:45:53.208348 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af858dc-1fe1-4f41-8f96-78d0ba502809 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:53.313610 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af858dc-1fe1-4f41-8f96-78d0ba502809 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:53.326877 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:53.348348 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac5c37-b5b5-4180-b1cb-c3cd4d5b3de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:53.348970 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac5c37-b5b5-4180-b1cb-c3cd4d5b3de0 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:53.349311 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac5c37-b5b5-4180-b1cb-c3cd4d5b3de0 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:53.349587 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac5c37-b5b5-4180-b1cb-c3cd4d5b3de0 None admin] PATH_INFO: `/v3/users/4b2dd9ba613b47b8b4618c0c2e6e4e48` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:53.350757 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac5c37-b5b5-4180-b1cb-c3cd4d5b3de0 None admin] RBAC: Authorizing `identity:get_user(user_id=4b2dd9ba613b47b8b4618c0c2e6e4e48)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:53.352200 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac5c37-b5b5-4180-b1cb-c3cd4d5b3de0 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:53.353798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 28/51] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:45:53 2022] GET /identity/v3/users/4b2dd9ba613b47b8b4618c0c2e6e4e48 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:45:53.359959 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886f4fd-e1a9-4a46-9e5c-aa562aded20c None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:53.440834 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ede1a-cc18-42d6-8e09-b4bff1f9e7e4 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:53.441038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ede1a-cc18-42d6-8e09-b4bff1f9e7e4 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:53.441323 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ede1a-cc18-42d6-8e09-b4bff1f9e7e4 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:53.442666 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 29/52] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:45:53.447392 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4810c-e6ac-4993-8c19-21c26e9271fb None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:53.448092 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4810c-e6ac-4993-8c19-21c26e9271fb None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:53.448371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4810c-e6ac-4993-8c19-21c26e9271fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:53.460139 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886f4fd-e1a9-4a46-9e5c-aa562aded20c None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:53.466922 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-20e4810c-e6ac-4993-8c19-21c26e9271fb None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:45:53.468132 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-20e4810c-e6ac-4993-8c19-21c26e9271fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:45:53.496369 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c28cb4-3154-4d2c-bbac-fedec67bffbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:53.497001 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28cb4-3154-4d2c-bbac-fedec67bffbc None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:53.497284 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28cb4-3154-4d2c-bbac-fedec67bffbc None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:53.497556 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28cb4-3154-4d2c-bbac-fedec67bffbc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:53.499308 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c28cb4-3154-4d2c-bbac-fedec67bffbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:53.500763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c28cb4-3154-4d2c-bbac-fedec67bffbc None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:53.502373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 24/53] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:45:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:45:53.508110 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c28cb4-3154-4d2c-bbac-fedec67bffbc None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:53.535563 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 30/54] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:45:53.537357 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:53.610371 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c28cb4-3154-4d2c-bbac-fedec67bffbc None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:53.642898 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8083c7-51eb-4f04-863a-3445740d13d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:53.643491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8083c7-51eb-4f04-863a-3445740d13d8 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:53.643770 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8083c7-51eb-4f04-863a-3445740d13d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:53.644044 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8083c7-51eb-4f04-863a-3445740d13d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:53.644758 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8083c7-51eb-4f04-863a-3445740d13d8 None admin] RBAC: Adding query filter params (role.id=a307f157f2a445c7af8bd4fd41aa1c4b, scope.domain.id=default, user.id=4b2dd9ba613b47b8b4618c0c2e6e4e48) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:45:53.645062 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8083c7-51eb-4f04-863a-3445740d13d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:53.646521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8083c7-51eb-4f04-863a-3445740d13d8 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:53.655003 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 25/55] 10.222.0.30 () {56 vars in 1322 bytes} [Wed Aug 17 14:45:53 2022] GET /identity/v3/role_assignments?user.id=4b2dd9ba613b47b8b4618c0c2e6e4e48&scope.domain.id=default&role.id=a307f157f2a445c7af8bd4fd41aa1c4b => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:45:53.875318 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4810c-e6ac-4993-8c19-21c26e9271fb None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:53.978311 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4810c-e6ac-4993-8c19-21c26e9271fb None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:53.989892 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:54.013766 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c256881-afc0-4f71-832b-a03d7bd914ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:54.014558 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c256881-afc0-4f71-832b-a03d7bd914ac None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:54.014835 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c256881-afc0-4f71-832b-a03d7bd914ac None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:54.015107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c256881-afc0-4f71-832b-a03d7bd914ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:54.016207 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c256881-afc0-4f71-832b-a03d7bd914ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:54.017657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c256881-afc0-4f71-832b-a03d7bd914ac None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:54.019228 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 31/56] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:45:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:45:54.024854 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8083c7-51eb-4f04-863a-3445740d13d8 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:54.117432 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:54.124716 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8083c7-51eb-4f04-863a-3445740d13d8 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:54.157364 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11c936-183a-4164-af4e-2b2071311e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:54.157926 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11c936-183a-4164-af4e-2b2071311e08 None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:54.158210 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11c936-183a-4164-af4e-2b2071311e08 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:54.158484 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11c936-183a-4164-af4e-2b2071311e08 None admin] PATH_INFO: `/v3/projects` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:54.159128 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11c936-183a-4164-af4e-2b2071311e08 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:54.160569 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11c936-183a-4164-af4e-2b2071311e08 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:54.186619 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 26/57] 10.222.0.30 () {60 vars in 1140 bytes} [Wed Aug 17 14:45:54 2022] POST /identity/v3/projects => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:45:56.376802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28170d2f-05fb-403f-b010-0ee5efe36394 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:56.377313 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28170d2f-05fb-403f-b010-0ee5efe36394 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:56.377394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28170d2f-05fb-403f-b010-0ee5efe36394 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:56.378717 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 32/58] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:45:56.383811 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80216f-509f-4cf3-a1cc-b79ed6166444 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:56.384249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80216f-509f-4cf3-a1cc-b79ed6166444 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:56.384363 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80216f-509f-4cf3-a1cc-b79ed6166444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:56.402340 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-cd80216f-509f-4cf3-a1cc-b79ed6166444 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:45:56.403543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-cd80216f-509f-4cf3-a1cc-b79ed6166444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:45:56.469555 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 27/59] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:45:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:45:56.799969 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28170d2f-05fb-403f-b010-0ee5efe36394 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:56.901120 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28170d2f-05fb-403f-b010-0ee5efe36394 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:56.936067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406ede1-e876-4fc9-9dba-a0ab574fa71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:56.936677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406ede1-e876-4fc9-9dba-a0ab574fa71b None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:56.936957 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406ede1-e876-4fc9-9dba-a0ab574fa71b None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:56.937233 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406ede1-e876-4fc9-9dba-a0ab574fa71b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:56.938340 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406ede1-e876-4fc9-9dba-a0ab574fa71b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:56.939768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406ede1-e876-4fc9-9dba-a0ab574fa71b None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:56.941301 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 33/60] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:45:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:45:56.946803 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80216f-509f-4cf3-a1cc-b79ed6166444 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:45:57.019691 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:45:57.043659 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80216f-509f-4cf3-a1cc-b79ed6166444 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:45:57.076280 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6fdc1-acb4-4ea8-a49e-b5cb652019e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:45:57.076808 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6fdc1-acb4-4ea8-a49e-b5cb652019e2 None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:45:57.077085 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6fdc1-acb4-4ea8-a49e-b5cb652019e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:45:57.077359 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6fdc1-acb4-4ea8-a49e-b5cb652019e2 None admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:45:57.078024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6fdc1-acb4-4ea8-a49e-b5cb652019e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:45:57.079440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6fdc1-acb4-4ea8-a49e-b5cb652019e2 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:45:57.104686 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 28/61] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 17 14:45:56 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:46:00.496990 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dfcc2-4016-4c0c-8f30-5109812670da None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:00.498240 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dfcc2-4016-4c0c-8f30-5109812670da None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:00.498727 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dfcc2-4016-4c0c-8f30-5109812670da None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:00.500759 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 34/62] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:00.506306 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61566247-6d76-413d-b3bb-ddb5e85d2ef2 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:00.507274 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61566247-6d76-413d-b3bb-ddb5e85d2ef2 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:00.507761 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61566247-6d76-413d-b3bb-ddb5e85d2ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:00.534765 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-61566247-6d76-413d-b3bb-ddb5e85d2ef2 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:00.536317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-61566247-6d76-413d-b3bb-ddb5e85d2ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:00.604992 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de62f5c-b5fb-4b2e-9043-885b9f9487a3 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:00.605637 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de62f5c-b5fb-4b2e-9043-885b9f9487a3 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:00.606152 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de62f5c-b5fb-4b2e-9043-885b9f9487a3 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:00.608221 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 35/63] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:00.634290 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 29/64] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:00.634608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1affe8-112c-4b06-951a-74d83094ab77 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:00.635021 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1affe8-112c-4b06-951a-74d83094ab77 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:00.635371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1affe8-112c-4b06-951a-74d83094ab77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:00.674771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-dd1affe8-112c-4b06-951a-74d83094ab77 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:00.676080 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-dd1affe8-112c-4b06-951a-74d83094ab77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:00.698242 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e285db9-67c4-4455-bed7-5a5f1347a236 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:00.698525 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e285db9-67c4-4455-bed7-5a5f1347a236 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:00.698804 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e285db9-67c4-4455-bed7-5a5f1347a236 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:00.700137 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 30/65] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:46:00.705767 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365503dc-0135-42f1-a6df-8191e86afe30 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:00.706064 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365503dc-0135-42f1-a6df-8191e86afe30 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:00.706341 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365503dc-0135-42f1-a6df-8191e86afe30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:00.727200 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-365503dc-0135-42f1-a6df-8191e86afe30 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:00.728392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-365503dc-0135-42f1-a6df-8191e86afe30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:00.766179 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:00.815267 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 36/66] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:00.836511 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:00.855244 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 31/67] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:46:00.976929 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1affe8-112c-4b06-951a-74d83094ab77 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:01.015150 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d655dd8-becf-4758-93cb-129bd7b2270a None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:01.015793 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d655dd8-becf-4758-93cb-129bd7b2270a None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:01.016316 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d655dd8-becf-4758-93cb-129bd7b2270a None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:01.017858 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 32/68] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:01.022814 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c283104-d274-427b-b7f7-e9f7b31dc296 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:01.023325 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c283104-d274-427b-b7f7-e9f7b31dc296 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:01.024009 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c283104-d274-427b-b7f7-e9f7b31dc296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:01.058994 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-1c283104-d274-427b-b7f7-e9f7b31dc296 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:01.060871 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-1c283104-d274-427b-b7f7-e9f7b31dc296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:01.171969 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1affe8-112c-4b06-951a-74d83094ab77 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:01.192178 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 33/69] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:01.193116 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c283104-d274-427b-b7f7-e9f7b31dc296 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:01.213456 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f865e-276c-4397-a8ee-1a0e07ea93bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:01.214447 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f865e-276c-4397-a8ee-1a0e07ea93bf None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:01.214921 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f865e-276c-4397-a8ee-1a0e07ea93bf None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:01.215389 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f865e-276c-4397-a8ee-1a0e07ea93bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:01.228115 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f865e-276c-4397-a8ee-1a0e07ea93bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:01.233895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-5e2f865e-276c-4397-a8ee-1a0e07ea93bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:46:01.233895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:01.233895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:01.233895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:01.233895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:01.233895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:01.233895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:01.233895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:01.233895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:01.233895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:01.233895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:01.233895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:01.233895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:01.233895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:01.233895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:01.233895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:01.234733 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:01.234733 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:01.234733 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:01.234733 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:01.234733 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:01.234733 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:01.234733 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:01.234733 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:01.234733 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:01.234733 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:01.234733 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:01.234733 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:01.234733 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:01.234733 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:01.234733 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:01.234733 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:01.235486 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:01.235486 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:01.235486 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:01.235486 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:01.235486 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:01.235486 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:01.235486 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:01.235486 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:01.235486 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:01.235486 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:01.235486 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:46:01.235486 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:01.238189 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 37/70] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 17 14:46:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:01.246607 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f865e-276c-4397-a8ee-1a0e07ea93bf None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:01.323882 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:01.347572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c283104-d274-427b-b7f7-e9f7b31dc296 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:01.378129 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:01.392394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f1d64-4621-495e-80ca-a86f704f35b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:01.393613 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f1d64-4621-495e-80ca-a86f704f35b9 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:01.394125 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f1d64-4621-495e-80ca-a86f704f35b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:01.394617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f1d64-4621-495e-80ca-a86f704f35b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:01.396442 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f865e-276c-4397-a8ee-1a0e07ea93bf None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:01.407232 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f1d64-4621-495e-80ca-a86f704f35b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:01.412692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-815f1d64-4621-495e-80ca-a86f704f35b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:01.412692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:01.412692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:01.412692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:01.412692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:01.412692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:01.412692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:01.412692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:01.412692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:01.412692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:01.412692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:01.412692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:01.412692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:01.412692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:01.412692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:01.412692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:01.413532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:01.413532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:01.413532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:01.413532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:01.413532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:01.413532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:01.413532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:01.413532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:01.413532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:01.413532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:01.413532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:01.413532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:01.413532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:01.413532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:01.413532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:01.413532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:01.414351 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:01.414351 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:01.414351 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:01.414351 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:01.414351 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:01.414351 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:01.414351 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:01.414351 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:01.414351 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:01.414351 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:01.414351 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:01.414351 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:46:01.416575 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 34/71] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:01.418825 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f1d64-4621-495e-80ca-a86f704f35b9 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:01.434456 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8e19d-d026-45ab-ae06-2ebcacf143f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:01.435596 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8e19d-d026-45ab-ae06-2ebcacf143f3 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:01.436104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8e19d-d026-45ab-ae06-2ebcacf143f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:01.436552 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8e19d-d026-45ab-ae06-2ebcacf143f3 None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:01.437400 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8e19d-d026-45ab-ae06-2ebcacf143f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:01.437994 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8e19d-d026-45ab-ae06-2ebcacf143f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:01.439598 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8e19d-d026-45ab-ae06-2ebcacf143f3 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:01.448595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 38/72] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:01.454611 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8e19d-d026-45ab-ae06-2ebcacf143f3 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:01.531799 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f1d64-4621-495e-80ca-a86f704f35b9 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:01.562954 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:01.567134 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8e19d-d026-45ab-ae06-2ebcacf143f3 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:01.569485 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc0557-d733-4bfe-bc6a-c4cf0a290dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:01.570151 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc0557-d733-4bfe-bc6a-c4cf0a290dd5 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:01.570436 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc0557-d733-4bfe-bc6a-c4cf0a290dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:01.570712 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc0557-d733-4bfe-bc6a-c4cf0a290dd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:01.580898 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc0557-d733-4bfe-bc6a-c4cf0a290dd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:01.585521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-1bbc0557-d733-4bfe-bc6a-c4cf0a290dd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:01.585521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:01.585521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:01.585521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:01.585521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:01.585521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:01.585521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:01.585521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:01.585521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:01.585521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:01.585521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:01.585521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:01.585521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:01.585521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:01.585521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:01.585521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:01.586532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:01.586532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:01.586532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:01.586532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:01.586532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:01.586532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:01.586532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:01.586532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:01.586532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:01.586532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:01.586532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:01.586532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:01.586532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:01.586532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:01.586532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:01.586532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:01.587331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:01.587331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:01.587331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:01.587331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:01.587331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:01.587331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:01.587331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:01.587331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:01.587331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:01.587331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:01.587331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:01.587331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:46:01.587331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 35/73] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:46:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:01.587962 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc0557-d733-4bfe-bc6a-c4cf0a290dd5 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:01.604904 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bfd5c-596f-4dc9-bfa8-24cc36ff5e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:01.605510 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bfd5c-596f-4dc9-bfa8-24cc36ff5e64 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:01.605838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bfd5c-596f-4dc9-bfa8-24cc36ff5e64 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:01.606122 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bfd5c-596f-4dc9-bfa8-24cc36ff5e64 None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:01.606798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bfd5c-596f-4dc9-bfa8-24cc36ff5e64 None admin] RBAC: Adding query filter params (name=member) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:01.607223 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bfd5c-596f-4dc9-bfa8-24cc36ff5e64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:01.608748 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bfd5c-596f-4dc9-bfa8-24cc36ff5e64 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:01.616785 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 39/74] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:01.617995 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee443a-e926-4ee3-9f9a-8ece2aa95bd9 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:01.618277 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee443a-e926-4ee3-9f9a-8ece2aa95bd9 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:01.618548 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee443a-e926-4ee3-9f9a-8ece2aa95bd9 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:01.619725 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 40/75] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:01.625381 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee443a-e926-4ee3-9f9a-8ece2aa95bd9 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:01.638061 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:01.693723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc0557-d733-4bfe-bc6a-c4cf0a290dd5 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:01.726392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24064606-130b-493b-9b0a-f1fe523401e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:01.727011 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24064606-130b-493b-9b0a-f1fe523401e8 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:01.727287 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24064606-130b-493b-9b0a-f1fe523401e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:01.727735 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24064606-130b-493b-9b0a-f1fe523401e8 None admin] PATH_INFO: `/v3/users/4b2dd9ba613b47b8b4618c0c2e6e4e48` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:01.728692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24064606-130b-493b-9b0a-f1fe523401e8 None admin] RBAC: Authorizing `identity:get_user(user_id=4b2dd9ba613b47b8b4618c0c2e6e4e48)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:01.728906 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee443a-e926-4ee3-9f9a-8ece2aa95bd9 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:01.730166 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24064606-130b-493b-9b0a-f1fe523401e8 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:01.732420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 36/76] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:01 2022] GET /identity/v3/users/4b2dd9ba613b47b8b4618c0c2e6e4e48 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:01.733121 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24064606-130b-493b-9b0a-f1fe523401e8 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:01.772402 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288d5e2-06a8-4bfb-b44d-1f090a16e65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:01.773024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288d5e2-06a8-4bfb-b44d-1f090a16e65d None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:01.773305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288d5e2-06a8-4bfb-b44d-1f090a16e65d None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:01.773577 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288d5e2-06a8-4bfb-b44d-1f090a16e65d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:01.783969 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288d5e2-06a8-4bfb-b44d-1f090a16e65d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:01.789014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-e288d5e2-06a8-4bfb-b44d-1f090a16e65d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:01.789014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:01.789014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:01.789014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:01.789014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:01.789014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:01.789014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:01.789014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:01.789014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:01.789014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:01.789014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:01.789014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:01.789014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:01.789014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:01.789014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:01.789014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:01.789928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:01.789928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:01.789928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:01.789928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:01.789928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:01.789928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:01.789928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:01.789928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:01.789928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:01.789928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:01.789928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:01.789928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:01.789928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:01.789928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:01.789928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:01.789928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:01.790869 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:01.790869 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:01.790869 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:01.790869 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:01.790869 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:01.790869 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:01.790869 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:01.790869 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:01.790869 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:01.790869 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:01.790869 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:01.790869 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:01.790869 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 41/77] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:01.790869 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288d5e2-06a8-4bfb-b44d-1f090a16e65d None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:01.813796 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:01.842967 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24064606-130b-493b-9b0a-f1fe523401e8 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:01.853325 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:01.879286 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525f64e-ece4-4b1f-a7ce-b43098e79272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:01.879889 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525f64e-ece4-4b1f-a7ce-b43098e79272 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:01.880174 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525f64e-ece4-4b1f-a7ce-b43098e79272 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:01.880451 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525f64e-ece4-4b1f-a7ce-b43098e79272 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:01.881119 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525f64e-ece4-4b1f-a7ce-b43098e79272 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:01.881425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525f64e-ece4-4b1f-a7ce-b43098e79272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:01.882844 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525f64e-ece4-4b1f-a7ce-b43098e79272 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:01.890778 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 37/78] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:46:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:01.892051 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3407d7-f2b3-4235-bcb3-05fc18a07d88 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:01.892349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3407d7-f2b3-4235-bcb3-05fc18a07d88 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:01.892567 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288d5e2-06a8-4bfb-b44d-1f090a16e65d None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:01.892665 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3407d7-f2b3-4235-bcb3-05fc18a07d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:01.909845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-0c3407d7-f2b3-4235-bcb3-05fc18a07d88 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:01.911052 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-0c3407d7-f2b3-4235-bcb3-05fc18a07d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:01.926621 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f69d6-b619-46c2-aa49-a3b1c644a8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:01.927252 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f69d6-b619-46c2-aa49-a3b1c644a8c9 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:01.927535 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f69d6-b619-46c2-aa49-a3b1c644a8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:01.927812 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f69d6-b619-46c2-aa49-a3b1c644a8c9 None admin] PATH_INFO: `/v3/users/2887a095d202430d88cb368b25d74f6b` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:01.941541 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f69d6-b619-46c2-aa49-a3b1c644a8c9 None admin] RBAC: Authorizing `identity:get_user(user_id=2887a095d202430d88cb368b25d74f6b)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:01.943037 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f69d6-b619-46c2-aa49-a3b1c644a8c9 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:01.944644 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 42/79] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:01 2022] GET /identity/v3/users/2887a095d202430d88cb368b25d74f6b => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:01.945405 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f69d6-b619-46c2-aa49-a3b1c644a8c9 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:01.977661 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 38/80] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:01.983877 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3407d7-f2b3-4235-bcb3-05fc18a07d88 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:02.021741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:02.046565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f69d6-b619-46c2-aa49-a3b1c644a8c9 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:02.085855 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166eef10-074c-4398-9fd6-dfa919d50f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:02.086468 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eef10-074c-4398-9fd6-dfa919d50f1a None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:02.086755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eef10-074c-4398-9fd6-dfa919d50f1a None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:02.087031 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eef10-074c-4398-9fd6-dfa919d50f1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:02.098188 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3407d7-f2b3-4235-bcb3-05fc18a07d88 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:02.100530 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:02.135360 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d634f7-0051-4fa9-9e5e-3e619e93e0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:02.135970 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d634f7-0051-4fa9-9e5e-3e619e93e0c2 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:02.136251 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d634f7-0051-4fa9-9e5e-3e619e93e0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:02.136531 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d634f7-0051-4fa9-9e5e-3e619e93e0c2 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:02.137247 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d634f7-0051-4fa9-9e5e-3e619e93e0c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:02.137557 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d634f7-0051-4fa9-9e5e-3e619e93e0c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:02.139088 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d634f7-0051-4fa9-9e5e-3e619e93e0c2 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:02.149868 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 39/81] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:02.150950 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d634f7-0051-4fa9-9e5e-3e619e93e0c2 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:02.168076 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166eef10-074c-4398-9fd6-dfa919d50f1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:02.170360 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166eef10-074c-4398-9fd6-dfa919d50f1a None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:02.252935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:02.253848 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d634f7-0051-4fa9-9e5e-3e619e93e0c2 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:02.277287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 43/82] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:02.277287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166eef10-074c-4398-9fd6-dfa919d50f1a None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:02.292091 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a123185-40f7-4b94-bbee-78cf61b3dcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:02.292730 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a123185-40f7-4b94-bbee-78cf61b3dcc0 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:02.293055 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a123185-40f7-4b94-bbee-78cf61b3dcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:02.293290 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a123185-40f7-4b94-bbee-78cf61b3dcc0 None admin] PATH_INFO: `/v3/users/2887a095d202430d88cb368b25d74f6b` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:02.295049 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a123185-40f7-4b94-bbee-78cf61b3dcc0 None admin] RBAC: Authorizing `identity:get_user(user_id=2887a095d202430d88cb368b25d74f6b)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:02.296662 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a123185-40f7-4b94-bbee-78cf61b3dcc0 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:02.298275 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 40/83] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:02 2022] GET /identity/v3/users/2887a095d202430d88cb368b25d74f6b => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:02.299035 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a123185-40f7-4b94-bbee-78cf61b3dcc0 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:02.331457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:02.384845 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166eef10-074c-4398-9fd6-dfa919d50f1a None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:02.403787 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a123185-40f7-4b94-bbee-78cf61b3dcc0 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:02.420039 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcc96a-1d92-4805-a7ff-5324d8d56e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:02.420568 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcc96a-1d92-4805-a7ff-5324d8d56e1b None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:02.420849 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcc96a-1d92-4805-a7ff-5324d8d56e1b None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:02.421121 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcc96a-1d92-4805-a7ff-5324d8d56e1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:02.439339 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b56fdd-1e46-440f-981b-f5dda0b93855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:02.439966 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b56fdd-1e46-440f-981b-f5dda0b93855 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:02.440257 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b56fdd-1e46-440f-981b-f5dda0b93855 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:02.440524 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b56fdd-1e46-440f-981b-f5dda0b93855 None admin] PATH_INFO: `/v3/users/2887a095d202430d88cb368b25d74f6b` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:02.441649 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b56fdd-1e46-440f-981b-f5dda0b93855 None admin] RBAC: Authorizing `identity:get_user(user_id=2887a095d202430d88cb368b25d74f6b)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:02.443123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b56fdd-1e46-440f-981b-f5dda0b93855 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:02.444698 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 41/84] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:02 2022] GET /identity/v3/users/2887a095d202430d88cb368b25d74f6b => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:02.449994 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b56fdd-1e46-440f-981b-f5dda0b93855 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:02.470842 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:02.493544 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcc96a-1d92-4805-a7ff-5324d8d56e1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:02.495057 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcc96a-1d92-4805-a7ff-5324d8d56e1b None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:02.547948 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:02.553496 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b56fdd-1e46-440f-981b-f5dda0b93855 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:02.587692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22020fc-fb42-4315-b84f-18b1b9ed13bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:02.588312 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22020fc-fb42-4315-b84f-18b1b9ed13bd None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:02.588588 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22020fc-fb42-4315-b84f-18b1b9ed13bd None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:02.588882 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22020fc-fb42-4315-b84f-18b1b9ed13bd None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:02.590027 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22020fc-fb42-4315-b84f-18b1b9ed13bd None admin] RBAC: Authorizing `identity:get_project(project_id=a7643b24b47f42eab63dd25e22c5cdb2)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:02.592268 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22020fc-fb42-4315-b84f-18b1b9ed13bd None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:02.594243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 42/85] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:02 2022] GET /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:02.594833 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22020fc-fb42-4315-b84f-18b1b9ed13bd None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:02.600566 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 44/86] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:02.601418 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcc96a-1d92-4805-a7ff-5324d8d56e1b None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:02.679821 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:02.692797 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22020fc-fb42-4315-b84f-18b1b9ed13bd None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:02.702791 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcc96a-1d92-4805-a7ff-5324d8d56e1b None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:02.726259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366301b-3d1a-497c-88a9-ecf6e734520a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:02.726860 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366301b-3d1a-497c-88a9-ecf6e734520a None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:02.727137 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366301b-3d1a-497c-88a9-ecf6e734520a None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:02.727406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366301b-3d1a-497c-88a9-ecf6e734520a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:02.736738 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7663fc-901e-488b-8268-077649865674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:02.737358 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7663fc-901e-488b-8268-077649865674 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:02.737651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7663fc-901e-488b-8268-077649865674 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:02.737959 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7663fc-901e-488b-8268-077649865674 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:02.739065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7663fc-901e-488b-8268-077649865674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:02.740518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7663fc-901e-488b-8268-077649865674 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:02.742261 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 45/87] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:46:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:02.742858 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7663fc-901e-488b-8268-077649865674 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:02.762285 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:02.796123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366301b-3d1a-497c-88a9-ecf6e734520a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:02.797633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366301b-3d1a-497c-88a9-ecf6e734520a None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:02.846493 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7663fc-901e-488b-8268-077649865674 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:02.880759 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e20d51-d2ce-40c9-945f-933955f1e645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:02.881362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e20d51-d2ce-40c9-945f-933955f1e645 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:02.881644 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e20d51-d2ce-40c9-945f-933955f1e645 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:02.881966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e20d51-d2ce-40c9-945f-933955f1e645 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:02.896092 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 43/88] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:02.896929 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366301b-3d1a-497c-88a9-ecf6e734520a None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:02.899561 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:02.952904 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e20d51-d2ce-40c9-945f-933955f1e645 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:02.954489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e20d51-d2ce-40c9-945f-933955f1e645 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:02.962235 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:02.994328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366301b-3d1a-497c-88a9-ecf6e734520a None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:03.029007 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba3b62-9d71-43ee-b055-0aee8aee9ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:03.029601 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba3b62-9d71-43ee-b055-0aee8aee9ee7 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:03.029926 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba3b62-9d71-43ee-b055-0aee8aee9ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:03.030207 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba3b62-9d71-43ee-b055-0aee8aee9ee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:03.030948 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba3b62-9d71-43ee-b055-0aee8aee9ee7 None admin] RBAC: Adding query filter params (role.id=a307f157f2a445c7af8bd4fd41aa1c4b, scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2, user.id=4b2dd9ba613b47b8b4618c0c2e6e4e48) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:03.031244 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba3b62-9d71-43ee-b055-0aee8aee9ee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:03.032728 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba3b62-9d71-43ee-b055-0aee8aee9ee7 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:03.038027 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 44/89] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:46:02 2022] GET /identity/v3/role_assignments?user.id=4b2dd9ba613b47b8b4618c0c2e6e4e48&scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2&role.id=a307f157f2a445c7af8bd4fd41aa1c4b => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:03.038858 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba3b62-9d71-43ee-b055-0aee8aee9ee7 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:03.062051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 46/90] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:03.063336 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e20d51-d2ce-40c9-945f-933955f1e645 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:03.122125 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:03.159290 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba3b62-9d71-43ee-b055-0aee8aee9ee7 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:03.191364 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e20d51-d2ce-40c9-945f-933955f1e645 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:03.191992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:03.198328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fea53e-b01f-451c-bf7d-613669d2f9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:03.198983 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fea53e-b01f-451c-bf7d-613669d2f9a5 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:03.199261 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fea53e-b01f-451c-bf7d-613669d2f9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:03.199534 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fea53e-b01f-451c-bf7d-613669d2f9a5 None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:03.200776 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fea53e-b01f-451c-bf7d-613669d2f9a5 None admin] RBAC: Authorizing `identity:get_project(project_id=a7643b24b47f42eab63dd25e22c5cdb2)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:03.202306 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fea53e-b01f-451c-bf7d-613669d2f9a5 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:03.209034 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 45/91] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:03 2022] GET /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:03.209034 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fea53e-b01f-451c-bf7d-613669d2f9a5 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:03.237132 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af44ff-2ed3-4d48-9440-42be85276d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:03.237777 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af44ff-2ed3-4d48-9440-42be85276d7a None admin] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:03.238107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af44ff-2ed3-4d48-9440-42be85276d7a None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:03.238391 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af44ff-2ed3-4d48-9440-42be85276d7a None admin] PATH_INFO: `/v3/users` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:03.239036 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af44ff-2ed3-4d48-9440-42be85276d7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:03.240487 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af44ff-2ed3-4d48-9440-42be85276d7a None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:03.270016 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 47/92] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 17 14:46:03 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:46:03.271075 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af44ff-2ed3-4d48-9440-42be85276d7a None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:03.333319 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fea53e-b01f-451c-bf7d-613669d2f9a5 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:03.378476 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e5f00-1b3f-4a32-acb5-8ce322b0e742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:03.379441 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e5f00-1b3f-4a32-acb5-8ce322b0e742 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:03.379911 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e5f00-1b3f-4a32-acb5-8ce322b0e742 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:03.380449 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e5f00-1b3f-4a32-acb5-8ce322b0e742 None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:03.381983 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e5f00-1b3f-4a32-acb5-8ce322b0e742 None admin] RBAC: Authorizing `identity:get_project(project_id=a7643b24b47f42eab63dd25e22c5cdb2)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:03.383624 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e5f00-1b3f-4a32-acb5-8ce322b0e742 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:03.385527 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 46/93] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:03 2022] GET /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:03.386800 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e5f00-1b3f-4a32-acb5-8ce322b0e742 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:03.423683 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af44ff-2ed3-4d48-9440-42be85276d7a None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:03.426223 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:03.475918 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:03.482292 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1927401-936c-4d52-93df-f7a709690e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:03.483023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1927401-936c-4d52-93df-f7a709690e3b None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:03.483308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1927401-936c-4d52-93df-f7a709690e3b None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:03.483583 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1927401-936c-4d52-93df-f7a709690e3b None admin] PATH_INFO: `/v3/projects/463bc96ad8dc489881f94d8a42c1770d` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:03.488200 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1927401-936c-4d52-93df-f7a709690e3b None admin] RBAC: Authorizing `identity:get_project(project_id=463bc96ad8dc489881f94d8a42c1770d)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:03.488200 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1927401-936c-4d52-93df-f7a709690e3b None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:03.488949 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 48/94] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:03 2022] GET /identity/v3/projects/463bc96ad8dc489881f94d8a42c1770d => generated 312 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:03.489553 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1927401-936c-4d52-93df-f7a709690e3b None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:03.523741 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e5f00-1b3f-4a32-acb5-8ce322b0e742 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:03.574327 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8cd66-c0f8-423d-8d65-6e1e7168c544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:03.574953 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8cd66-c0f8-423d-8d65-6e1e7168c544 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:03.575330 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8cd66-c0f8-423d-8d65-6e1e7168c544 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:03.575665 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8cd66-c0f8-423d-8d65-6e1e7168c544 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:03.577212 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8cd66-c0f8-423d-8d65-6e1e7168c544 None admin] RBAC: Adding query filter params (role.id=ab06ca80774d48a191fece38e3f335ad, scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2, user.id=2887a095d202430d88cb368b25d74f6b) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:03.577537 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8cd66-c0f8-423d-8d65-6e1e7168c544 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:03.579009 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8cd66-c0f8-423d-8d65-6e1e7168c544 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:03.586112 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 47/95] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:46:03 2022] GET /identity/v3/role_assignments?user.id=2887a095d202430d88cb368b25d74f6b&scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2&role.id=ab06ca80774d48a191fece38e3f335ad => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:03.587673 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8cd66-c0f8-423d-8d65-6e1e7168c544 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:03.644289 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1927401-936c-4d52-93df-f7a709690e3b None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:03.698518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915387a-ae60-4b83-a3d3-d71b2be70934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:03.698518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915387a-ae60-4b83-a3d3-d71b2be70934 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:03.698518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915387a-ae60-4b83-a3d3-d71b2be70934 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:03.698518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915387a-ae60-4b83-a3d3-d71b2be70934 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:03.700134 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915387a-ae60-4b83-a3d3-d71b2be70934 None admin] RBAC: Adding query filter params (role.id=df9fac15c20d418187fbaf38acafd61f, scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2, user.id=2887a095d202430d88cb368b25d74f6b) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:03.702015 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915387a-ae60-4b83-a3d3-d71b2be70934 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:03.703118 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915387a-ae60-4b83-a3d3-d71b2be70934 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:03.713438 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 49/96] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:46:03 2022] GET /identity/v3/role_assignments?user.id=2887a095d202430d88cb368b25d74f6b&scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2&role.id=df9fac15c20d418187fbaf38acafd61f => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:03.757656 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8cd66-c0f8-423d-8d65-6e1e7168c544 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:03.796177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:03.801756 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63ed45-7122-4c8f-988d-6bb74fbd4cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:03.802683 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63ed45-7122-4c8f-988d-6bb74fbd4cbc None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:03.803175 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63ed45-7122-4c8f-988d-6bb74fbd4cbc None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:03.803648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63ed45-7122-4c8f-988d-6bb74fbd4cbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:03.804544 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63ed45-7122-4c8f-988d-6bb74fbd4cbc None admin] RBAC: Adding query filter params (role.id=ab06ca80774d48a191fece38e3f335ad, scope.project.id=463bc96ad8dc489881f94d8a42c1770d, user.id=2887a095d202430d88cb368b25d74f6b) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:03.805016 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63ed45-7122-4c8f-988d-6bb74fbd4cbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:03.806894 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63ed45-7122-4c8f-988d-6bb74fbd4cbc None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:03.814129 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 48/97] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:46:03 2022] GET /identity/v3/role_assignments?user.id=2887a095d202430d88cb368b25d74f6b&scope.project.id=463bc96ad8dc489881f94d8a42c1770d&role.id=ab06ca80774d48a191fece38e3f335ad => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:05.687868 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82719be-9e43-45f5-b125-8850f86e99c0 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:05.688866 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82719be-9e43-45f5-b125-8850f86e99c0 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:05.689362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82719be-9e43-45f5-b125-8850f86e99c0 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:05.691212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 50/98] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:05.696909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f288c2-2bbb-4a1e-bad8-a3fb5ca7728c None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:05.697800 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f288c2-2bbb-4a1e-bad8-a3fb5ca7728c None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:05.698267 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f288c2-2bbb-4a1e-bad8-a3fb5ca7728c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:05.724293 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-53f288c2-2bbb-4a1e-bad8-a3fb5ca7728c None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:05.725797 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-53f288c2-2bbb-4a1e-bad8-a3fb5ca7728c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:05.820099 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 49/99] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:06.605180 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82719be-9e43-45f5-b125-8850f86e99c0 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:06.678445 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:06.759671 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11122040-d8f0-4b20-bd06-2b209b10d687 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:06.760207 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11122040-d8f0-4b20-bd06-2b209b10d687 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:06.760207 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11122040-d8f0-4b20-bd06-2b209b10d687 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:06.761811 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 50/100] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:46:06.783298 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbab4a6-840a-4ba6-9757-0ed425905cf7 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:06.783613 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbab4a6-840a-4ba6-9757-0ed425905cf7 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:06.783857 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbab4a6-840a-4ba6-9757-0ed425905cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:06.795513 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82719be-9e43-45f5-b125-8850f86e99c0 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:06.822912 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-1cbab4a6-840a-4ba6-9757-0ed425905cf7 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:06.824047 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-1cbab4a6-840a-4ba6-9757-0ed425905cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:06.882417 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857ee92-31ae-4742-8963-ef3013f42169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:06.883461 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857ee92-31ae-4742-8963-ef3013f42169 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:06.883951 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857ee92-31ae-4742-8963-ef3013f42169 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:06.884314 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857ee92-31ae-4742-8963-ef3013f42169 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:06.914867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857ee92-31ae-4742-8963-ef3013f42169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:06.922812 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-1857ee92-31ae-4742-8963-ef3013f42169 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:46:06.922812 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:06.922812 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:06.922812 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:06.922812 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:06.922812 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:06.922812 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:06.922812 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:06.922812 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:06.922812 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:06.922812 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:06.922812 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:06.922812 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:06.922812 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:06.922812 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:06.922812 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:06.924067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:06.924067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:06.924067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:06.924067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:06.924067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:06.924067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:06.924067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:06.924067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:06.924067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:06.924067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:06.924067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:06.924067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:06.924067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:06.924067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:06.924067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:06.924067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:06.924895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:06.924895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:06.924895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:06.924895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:06.924895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:06.924895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:06.924895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:06.924895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:06.924895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:06.924895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:06.924895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:46:06.924895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:06.924895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 51/101] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 17 14:46:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:06.933433 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857ee92-31ae-4742-8963-ef3013f42169 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:06.990960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 51/102] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:07.001755 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118ac6b-3623-40e7-82fb-acaef830da77 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:07.001755 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118ac6b-3623-40e7-82fb-acaef830da77 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:07.001755 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118ac6b-3623-40e7-82fb-acaef830da77 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:07.001755 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 52/103] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:07.001755 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e8e42-64b6-464c-9bb8-b038ae8e1969 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:07.001755 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e8e42-64b6-464c-9bb8-b038ae8e1969 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:07.002217 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e8e42-64b6-464c-9bb8-b038ae8e1969 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:07.002217 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 53/104] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:07.008240 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8976e21-86bd-4ed2-99d4-9d55b4d6b60b None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:07.008529 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8976e21-86bd-4ed2-99d4-9d55b4d6b60b None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:07.008801 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8976e21-86bd-4ed2-99d4-9d55b4d6b60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:07.045418 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-b8976e21-86bd-4ed2-99d4-9d55b4d6b60b None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:07.046647 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-b8976e21-86bd-4ed2-99d4-9d55b4d6b60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:07.156606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:07.160735 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:07.171228 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857ee92-31ae-4742-8963-ef3013f42169 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:07.181240 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 54/105] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:07.182911 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3624fc7-e654-411a-bae2-ee9619901180 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:07.183422 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3624fc7-e654-411a-bae2-ee9619901180 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:07.188885 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3624fc7-e654-411a-bae2-ee9619901180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:07.220650 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-b3624fc7-e654-411a-bae2-ee9619901180 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:07.222163 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-b3624fc7-e654-411a-bae2-ee9619901180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:07.281757 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d05fb-dce9-4f6b-b133-dcef007a2b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:07.281757 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d05fb-dce9-4f6b-b133-dcef007a2b3a None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:07.281757 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d05fb-dce9-4f6b-b133-dcef007a2b3a None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:07.281757 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d05fb-dce9-4f6b-b133-dcef007a2b3a None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:07.282174 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d05fb-dce9-4f6b-b133-dcef007a2b3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:07.282174 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d05fb-dce9-4f6b-b133-dcef007a2b3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:07.282926 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d05fb-dce9-4f6b-b133-dcef007a2b3a None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:07.304288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 52/106] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:07.309492 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d05fb-dce9-4f6b-b133-dcef007a2b3a None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:07.328577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 55/107] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:07.384206 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce815559-b6c7-4e49-8ed2-93c11c6b5061 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:07.384713 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce815559-b6c7-4e49-8ed2-93c11c6b5061 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:07.385130 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce815559-b6c7-4e49-8ed2-93c11c6b5061 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:07.386672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 56/108] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:46:07.401213 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a2f9c-1227-4d79-8791-e94413630f2d None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:07.401752 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a2f9c-1227-4d79-8791-e94413630f2d None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:07.402171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a2f9c-1227-4d79-8791-e94413630f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:07.438882 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-d00a2f9c-1227-4d79-8791-e94413630f2d None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:07.440308 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-d00a2f9c-1227-4d79-8791-e94413630f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:07.499856 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d05fb-dce9-4f6b-b133-dcef007a2b3a None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:07.569781 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 57/109] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:07.569781 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a2f9c-1227-4d79-8791-e94413630f2d None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:07.572324 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10834a73-a1c9-496a-839c-77aa07ddc87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:07.572958 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10834a73-a1c9-496a-839c-77aa07ddc87e None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:07.573241 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10834a73-a1c9-496a-839c-77aa07ddc87e None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:07.573515 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10834a73-a1c9-496a-839c-77aa07ddc87e None admin] PATH_INFO: `/v3/users/4b2dd9ba613b47b8b4618c0c2e6e4e48` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:07.576149 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10834a73-a1c9-496a-839c-77aa07ddc87e None admin] RBAC: Authorizing `identity:get_user(user_id=4b2dd9ba613b47b8b4618c0c2e6e4e48)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:07.577478 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10834a73-a1c9-496a-839c-77aa07ddc87e None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:07.579098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 53/110] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:07 2022] GET /identity/v3/users/4b2dd9ba613b47b8b4618c0c2e6e4e48 => generated 247 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:07.589901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10834a73-a1c9-496a-839c-77aa07ddc87e None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:07.662096 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:07.705919 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:07.769001 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a2f9c-1227-4d79-8791-e94413630f2d None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:07.771437 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10834a73-a1c9-496a-839c-77aa07ddc87e None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:07.808550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8684a4b-6d8d-49b2-b72f-22f9db5999e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:07.809554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8684a4b-6d8d-49b2-b72f-22f9db5999e3 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:07.810852 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8684a4b-6d8d-49b2-b72f-22f9db5999e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:07.811357 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8684a4b-6d8d-49b2-b72f-22f9db5999e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:07.812710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8684a4b-6d8d-49b2-b72f-22f9db5999e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:07.814016 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9397c26-a090-4f0e-be5b-962004f2f9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:07.814706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9397c26-a090-4f0e-be5b-962004f2f9ea None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:07.814995 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9397c26-a090-4f0e-be5b-962004f2f9ea None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:07.815273 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9397c26-a090-4f0e-be5b-962004f2f9ea None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:07.815559 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8684a4b-6d8d-49b2-b72f-22f9db5999e3 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:07.816435 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9397c26-a090-4f0e-be5b-962004f2f9ea None admin] RBAC: Authorizing `identity:get_project(project_id=a7643b24b47f42eab63dd25e22c5cdb2)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:07.817882 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 58/111] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:46:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:07.817986 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9397c26-a090-4f0e-be5b-962004f2f9ea None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:07.819014 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8684a4b-6d8d-49b2-b72f-22f9db5999e3 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:07.823360 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 54/112] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:07 2022] GET /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:07.824475 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9397c26-a090-4f0e-be5b-962004f2f9ea None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:07.920503 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8684a4b-6d8d-49b2-b72f-22f9db5999e3 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:07.922699 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:07.931819 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9397c26-a090-4f0e-be5b-962004f2f9ea None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:07.936478 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:07.958721 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f17c86-4c7e-49d7-802a-e9092b7e4d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:07.959272 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f17c86-4c7e-49d7-802a-e9092b7e4d44 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:07.959553 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f17c86-4c7e-49d7-802a-e9092b7e4d44 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:07.959828 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f17c86-4c7e-49d7-802a-e9092b7e4d44 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:07.969802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbd450-01d1-401a-b25d-232160cbcfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:07.970420 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbd450-01d1-401a-b25d-232160cbcfc2 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:07.970692 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbd450-01d1-401a-b25d-232160cbcfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:07.970860 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f17c86-4c7e-49d7-802a-e9092b7e4d44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:07.970953 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbd450-01d1-401a-b25d-232160cbcfc2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:07.975774 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-c5f17c86-4c7e-49d7-802a-e9092b7e4d44 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:46:07.975774 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:07.975774 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:07.975774 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:07.975774 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:07.975774 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:07.975774 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:07.975774 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:07.975774 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:07.975774 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:07.975774 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:07.975774 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:07.975774 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:07.975774 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:07.975774 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:07.975774 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:07.976599 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:07.976599 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:07.976599 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:07.976599 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:07.976599 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:07.976599 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:07.976599 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:07.976599 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:07.976599 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:07.976599 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:07.976599 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:07.976599 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:07.976599 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:07.976599 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:07.976599 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:07.976599 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:07.977348 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:07.977348 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:07.977348 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:07.977348 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:07.977348 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:07.977348 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:07.977348 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:07.977348 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:07.977348 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:07.977348 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:07.977348 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:46:07.977348 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:46:07.977348 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 59/113] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:07.978651 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ae954-50cb-437c-982e-571b6a090ae3 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:07.978901 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ae954-50cb-437c-982e-571b6a090ae3 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:07.979128 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ae954-50cb-437c-982e-571b6a090ae3 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:07.980494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 60/114] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:07.981027 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ae954-50cb-437c-982e-571b6a090ae3 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:07.991067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbd450-01d1-401a-b25d-232160cbcfc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:07.995769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-bbdbd450-01d1-401a-b25d-232160cbcfc2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:07.995769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:07.995769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:07.995769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:07.995769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:07.995769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:07.995769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:07.995769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:07.995769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:07.995769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:07.995769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:07.995769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:07.995769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:07.995769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:07.995769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:07.995769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:07.996907 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:07.996907 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:07.996907 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:07.996907 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:07.996907 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:07.996907 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:07.996907 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:07.996907 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:07.996907 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:07.996907 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:07.996907 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:07.996907 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:07.996907 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:07.996907 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:07.996907 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:07.996907 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:07.998287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:07.998287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:07.998287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:07.998287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:07.998287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:07.998287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:07.998287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:07.998287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:07.998287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:07.998287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:07.998287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:07.998287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:07.998287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 55/115] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:07.999035 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbd450-01d1-401a-b25d-232160cbcfc2 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:08.097416 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ae954-50cb-437c-982e-571b6a090ae3 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:08.106513 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbd450-01d1-401a-b25d-232160cbcfc2 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:08.132044 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e295348-0c53-4da6-bae4-996d0e1b4608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:08.132649 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e295348-0c53-4da6-bae4-996d0e1b4608 None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:08.132957 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e295348-0c53-4da6-bae4-996d0e1b4608 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:08.133240 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e295348-0c53-4da6-bae4-996d0e1b4608 None admin] PATH_INFO: `/v3/projects` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:08.133936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e295348-0c53-4da6-bae4-996d0e1b4608 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:08.135369 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e295348-0c53-4da6-bae4-996d0e1b4608 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:08.141683 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ed5a8-b540-450b-9755-e609195d693e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:08.142351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ed5a8-b540-450b-9755-e609195d693e None admin] REQUEST_METHOD: `PUT` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:08.142635 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ed5a8-b540-450b-9755-e609195d693e None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:08.142914 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ed5a8-b540-450b-9755-e609195d693e None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2/users/4b2dd9ba613b47b8b4618c0c2e6e4e48/roles/a307f157f2a445c7af8bd4fd41aa1c4b` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:08.144819 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ed5a8-b540-450b-9755-e609195d693e None admin] RBAC: Authorizing `identity:create_grant(project_id=a7643b24b47f42eab63dd25e22c5cdb2, user_id=4b2dd9ba613b47b8b4618c0c2e6e4e48, role_id=a307f157f2a445c7af8bd4fd41aa1c4b)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:08.146716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ed5a8-b540-450b-9755-e609195d693e None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:08.159542 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 56/116] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 17 14:46:07 2022] PUT /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2/users/4b2dd9ba613b47b8b4618c0c2e6e4e48/roles/a307f157f2a445c7af8bd4fd41aa1c4b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:46:08.160398 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ed5a8-b540-450b-9755-e609195d693e None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:08.164333 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 61/117] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 17 14:46:07 2022] POST /identity/v3/projects => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:46:08.165905 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3915dd5-6da8-4001-ab39-d4ae6621606f None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:08.166203 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3915dd5-6da8-4001-ab39-d4ae6621606f None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:08.166777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3915dd5-6da8-4001-ab39-d4ae6621606f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:08.190025 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-e3915dd5-6da8-4001-ab39-d4ae6621606f None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:08.191591 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-e3915dd5-6da8-4001-ab39-d4ae6621606f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:08.193563 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:08.219134 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:08.284128 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 62/118] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:08.287215 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3915dd5-6da8-4001-ab39-d4ae6621606f None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:08.354493 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ed5a8-b540-450b-9755-e609195d693e None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:08.403044 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3226ade-1725-4ae2-bbcb-5f464fb0ca6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:08.403731 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3226ade-1725-4ae2-bbcb-5f464fb0ca6f None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:08.404016 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3226ade-1725-4ae2-bbcb-5f464fb0ca6f None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:08.404350 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3226ade-1725-4ae2-bbcb-5f464fb0ca6f None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:08.405028 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3226ade-1725-4ae2-bbcb-5f464fb0ca6f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:08.405972 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3226ade-1725-4ae2-bbcb-5f464fb0ca6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:08.408535 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3226ade-1725-4ae2-bbcb-5f464fb0ca6f None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:08.422465 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 57/119] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:08.422939 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3226ade-1725-4ae2-bbcb-5f464fb0ca6f None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:08.458002 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3915dd5-6da8-4001-ab39-d4ae6621606f None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:08.500131 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67b217-1313-47a5-8d93-7764669f1bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:08.500672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67b217-1313-47a5-8d93-7764669f1bdf None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:08.500956 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67b217-1313-47a5-8d93-7764669f1bdf None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:08.501231 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67b217-1313-47a5-8d93-7764669f1bdf None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:08.502671 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67b217-1313-47a5-8d93-7764669f1bdf None admin] RBAC: Adding query filter params (name=member) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:08.502988 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67b217-1313-47a5-8d93-7764669f1bdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:08.504379 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67b217-1313-47a5-8d93-7764669f1bdf None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:08.513453 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 63/120] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:08.514320 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67b217-1313-47a5-8d93-7764669f1bdf None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:08.535063 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:08.537096 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:08.575208 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3226ade-1725-4ae2-bbcb-5f464fb0ca6f None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:08.612569 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215679ef-44c7-4c8b-af12-091cfb240ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:08.613551 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215679ef-44c7-4c8b-af12-091cfb240ecd None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:08.614062 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215679ef-44c7-4c8b-af12-091cfb240ecd None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:08.614536 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215679ef-44c7-4c8b-af12-091cfb240ecd None admin] PATH_INFO: `/v3/roles/member` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:08.632405 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67b217-1313-47a5-8d93-7764669f1bdf None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:08.636935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215679ef-44c7-4c8b-af12-091cfb240ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:08.643177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-215679ef-44c7-4c8b-af12-091cfb240ecd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:08.643177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:08.643177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:08.643177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:08.643177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:08.643177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:08.643177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:08.643177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:08.643177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:08.643177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:08.643177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:08.643177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:08.643177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:08.643177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:08.643177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:08.643177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:08.644022 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:08.644022 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:08.644022 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:08.644022 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:08.644022 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:08.644022 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:08.644022 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:08.644022 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:08.644022 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:08.644022 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:08.644022 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:08.644022 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:08.644022 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:08.644022 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:08.644022 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:08.644022 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:08.644785 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:08.644785 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:08.644785 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:08.644785 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:08.644785 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:08.644785 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:08.644785 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:08.644785 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:08.644785 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:08.644785 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:08.644785 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:08.644785 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:08.653163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 58/121] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:08.654292 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215679ef-44c7-4c8b-af12-091cfb240ecd None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:08.693404 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261109fb-65ac-4b02-8471-ae3dd318891f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:08.694451 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261109fb-65ac-4b02-8471-ae3dd318891f None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:08.694914 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261109fb-65ac-4b02-8471-ae3dd318891f None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:08.695363 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261109fb-65ac-4b02-8471-ae3dd318891f None admin] PATH_INFO: `/v3/users/21728de833c341a69d04b96062f285d3` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:08.711898 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261109fb-65ac-4b02-8471-ae3dd318891f None admin] RBAC: Authorizing `identity:get_user(user_id=21728de833c341a69d04b96062f285d3)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:08.713667 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261109fb-65ac-4b02-8471-ae3dd318891f None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:08.715889 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 64/122] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:08 2022] GET /identity/v3/users/21728de833c341a69d04b96062f285d3 => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:08.717162 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261109fb-65ac-4b02-8471-ae3dd318891f None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:08.802688 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215679ef-44c7-4c8b-af12-091cfb240ecd None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:08.812052 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:08.838025 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261109fb-65ac-4b02-8471-ae3dd318891f None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:08.859160 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c69c2-f95a-44ae-be5a-d6ee77de8426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:08.859886 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c69c2-f95a-44ae-be5a-d6ee77de8426 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:08.860243 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c69c2-f95a-44ae-be5a-d6ee77de8426 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:08.860643 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c69c2-f95a-44ae-be5a-d6ee77de8426 None admin] PATH_INFO: `/v3/users/2887a095d202430d88cb368b25d74f6b` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:08.862257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c69c2-f95a-44ae-be5a-d6ee77de8426 None admin] RBAC: Authorizing `identity:get_user(user_id=2887a095d202430d88cb368b25d74f6b)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:08.863797 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c69c2-f95a-44ae-be5a-d6ee77de8426 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:08.866575 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 59/123] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:08 2022] GET /identity/v3/users/2887a095d202430d88cb368b25d74f6b => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:08.867776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c69c2-f95a-44ae-be5a-d6ee77de8426 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:08.872890 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:08.882241 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b16ed8-62eb-4bd1-81ab-4e9c451ccf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:08.883198 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b16ed8-62eb-4bd1-81ab-4e9c451ccf07 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:08.883681 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b16ed8-62eb-4bd1-81ab-4e9c451ccf07 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:08.884172 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b16ed8-62eb-4bd1-81ab-4e9c451ccf07 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:08.885040 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b16ed8-62eb-4bd1-81ab-4e9c451ccf07 None admin] RBAC: Adding query filter params (name=member) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:08.885563 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b16ed8-62eb-4bd1-81ab-4e9c451ccf07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:08.887319 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b16ed8-62eb-4bd1-81ab-4e9c451ccf07 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:08.897811 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 65/124] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:08.899059 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b16ed8-62eb-4bd1-81ab-4e9c451ccf07 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:09.010435 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c69c2-f95a-44ae-be5a-d6ee77de8426 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:09.014885 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b16ed8-62eb-4bd1-81ab-4e9c451ccf07 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:09.049457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8d50e-435c-4f6b-ab69-139535805469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:09.050571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8d50e-435c-4f6b-ab69-139535805469 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:09.051056 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8d50e-435c-4f6b-ab69-139535805469 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:09.051559 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8d50e-435c-4f6b-ab69-139535805469 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:09.062691 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8d50e-435c-4f6b-ab69-139535805469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:09.062808 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f945627-f7fa-48ba-957e-84d88a066b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:09.063278 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f945627-f7fa-48ba-957e-84d88a066b72 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:09.063629 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f945627-f7fa-48ba-957e-84d88a066b72 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:09.063930 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f945627-f7fa-48ba-957e-84d88a066b72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:09.069147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-82a8d50e-435c-4f6b-ab69-139535805469 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:09.069147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:09.069147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:09.069147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:09.069147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:09.069147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:09.069147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:09.069147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:09.069147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:09.069147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:09.069147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:09.069147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:09.069147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:09.069147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:09.069147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:09.069147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:09.070222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:09.070222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:09.070222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:09.070222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:09.070222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:09.070222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:09.070222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:09.070222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:09.070222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:09.070222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:09.070222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:09.070222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:09.070222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:09.070222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:09.070222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:09.070222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:09.071030 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:09.071030 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:09.071030 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:09.071030 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:09.071030 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:09.071030 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:09.071030 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:09.071030 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:09.071030 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:09.071030 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:09.071030 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:09.071030 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:09.072661 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:09.073897 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 60/125] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:46:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:09.076361 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8d50e-435c-4f6b-ab69-139535805469 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:09.152570 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f945627-f7fa-48ba-957e-84d88a066b72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:09.154545 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f945627-f7fa-48ba-957e-84d88a066b72 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:09.164968 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:09.207639 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8d50e-435c-4f6b-ab69-139535805469 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:09.250296 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79543f67-9e69-4402-9a16-9f5e9e03caff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:09.251377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79543f67-9e69-4402-9a16-9f5e9e03caff None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:09.251857 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79543f67-9e69-4402-9a16-9f5e9e03caff None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:09.252146 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79543f67-9e69-4402-9a16-9f5e9e03caff None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:09.253957 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79543f67-9e69-4402-9a16-9f5e9e03caff None admin] RBAC: Authorizing `identity:get_project(project_id=a7643b24b47f42eab63dd25e22c5cdb2)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:09.255699 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79543f67-9e69-4402-9a16-9f5e9e03caff None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:09.258530 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 61/126] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:09 2022] GET /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:09.259526 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79543f67-9e69-4402-9a16-9f5e9e03caff None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:09.278262 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 66/127] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:09.279789 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f945627-f7fa-48ba-957e-84d88a066b72 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:09.323388 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:09.392027 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f945627-f7fa-48ba-957e-84d88a066b72 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:09.406891 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79543f67-9e69-4402-9a16-9f5e9e03caff None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:09.433600 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3c609-158c-4099-a8b0-a21e43256edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:09.434728 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3c609-158c-4099-a8b0-a21e43256edd None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:09.435733 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3c609-158c-4099-a8b0-a21e43256edd None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:09.436241 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3c609-158c-4099-a8b0-a21e43256edd None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:09.437114 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3c609-158c-4099-a8b0-a21e43256edd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:09.437617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3c609-158c-4099-a8b0-a21e43256edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:09.439300 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3c609-158c-4099-a8b0-a21e43256edd None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:09.448327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:09.449982 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 67/128] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:46:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:09.453863 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3c609-158c-4099-a8b0-a21e43256edd None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:09.463014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089532d-110d-4831-828f-c0125137fa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:09.464063 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089532d-110d-4831-828f-c0125137fa96 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:09.464672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089532d-110d-4831-828f-c0125137fa96 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:09.465151 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089532d-110d-4831-828f-c0125137fa96 None admin] PATH_INFO: `/v3/users/2887a095d202430d88cb368b25d74f6b` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:09.466960 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089532d-110d-4831-828f-c0125137fa96 None admin] RBAC: Authorizing `identity:get_user(user_id=2887a095d202430d88cb368b25d74f6b)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:09.468896 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089532d-110d-4831-828f-c0125137fa96 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:09.471242 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 62/129] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:09 2022] GET /identity/v3/users/2887a095d202430d88cb368b25d74f6b => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:09.472444 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089532d-110d-4831-828f-c0125137fa96 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:09.577639 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:09.582631 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3c609-158c-4099-a8b0-a21e43256edd None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:09.610398 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089532d-110d-4831-828f-c0125137fa96 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:09.628862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afd632-7307-4e38-abeb-4f984b9a3169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:09.630382 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afd632-7307-4e38-abeb-4f984b9a3169 None admin] REQUEST_METHOD: `PUT` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:09.630816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afd632-7307-4e38-abeb-4f984b9a3169 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:09.631230 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afd632-7307-4e38-abeb-4f984b9a3169 None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2/users/2887a095d202430d88cb368b25d74f6b/roles/ab06ca80774d48a191fece38e3f335ad` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:09.633879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afd632-7307-4e38-abeb-4f984b9a3169 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7643b24b47f42eab63dd25e22c5cdb2, user_id=2887a095d202430d88cb368b25d74f6b, role_id=ab06ca80774d48a191fece38e3f335ad)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:09.636052 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afd632-7307-4e38-abeb-4f984b9a3169 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:09.652816 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e749f9-ae8e-4c35-bf19-a0f5155dcd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:09.654366 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e749f9-ae8e-4c35-bf19-a0f5155dcd90 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:09.655302 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e749f9-ae8e-4c35-bf19-a0f5155dcd90 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:09.655580 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e749f9-ae8e-4c35-bf19-a0f5155dcd90 None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:09.658201 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 68/130] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 17 14:46:09 2022] PUT /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2/users/2887a095d202430d88cb368b25d74f6b/roles/ab06ca80774d48a191fece38e3f335ad => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:46:09.658738 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e749f9-ae8e-4c35-bf19-a0f5155dcd90 None admin] RBAC: Authorizing `identity:get_project(project_id=a7643b24b47f42eab63dd25e22c5cdb2)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:09.659023 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afd632-7307-4e38-abeb-4f984b9a3169 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:09.660900 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e749f9-ae8e-4c35-bf19-a0f5155dcd90 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:09.664360 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 63/131] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:09 2022] GET /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:09.665595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e749f9-ae8e-4c35-bf19-a0f5155dcd90 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:09.772196 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:09.793165 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afd632-7307-4e38-abeb-4f984b9a3169 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:09.819476 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e749f9-ae8e-4c35-bf19-a0f5155dcd90 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:09.836404 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46452543-1f62-4af8-9515-b376fd876263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:09.837831 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46452543-1f62-4af8-9515-b376fd876263 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:09.838321 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46452543-1f62-4af8-9515-b376fd876263 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:09.838795 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46452543-1f62-4af8-9515-b376fd876263 None admin] PATH_INFO: `/v3/users/2887a095d202430d88cb368b25d74f6b` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:09.840301 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46452543-1f62-4af8-9515-b376fd876263 None admin] RBAC: Authorizing `identity:get_user(user_id=2887a095d202430d88cb368b25d74f6b)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:09.843068 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46452543-1f62-4af8-9515-b376fd876263 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:09.845031 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 69/132] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:09 2022] GET /identity/v3/users/2887a095d202430d88cb368b25d74f6b => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:09.846077 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46452543-1f62-4af8-9515-b376fd876263 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:09.860155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76843fb2-c075-4dd2-a98a-04c6e4bb0c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:09.860663 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76843fb2-c075-4dd2-a98a-04c6e4bb0c96 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:09.860885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76843fb2-c075-4dd2-a98a-04c6e4bb0c96 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:09.861158 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76843fb2-c075-4dd2-a98a-04c6e4bb0c96 None admin] PATH_INFO: `/v3/projects/463bc96ad8dc489881f94d8a42c1770d` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:09.862401 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76843fb2-c075-4dd2-a98a-04c6e4bb0c96 None admin] RBAC: Authorizing `identity:get_project(project_id=463bc96ad8dc489881f94d8a42c1770d)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:09.863929 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76843fb2-c075-4dd2-a98a-04c6e4bb0c96 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:09.865996 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 64/133] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:09 2022] GET /identity/v3/projects/463bc96ad8dc489881f94d8a42c1770d => generated 312 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:09.866793 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76843fb2-c075-4dd2-a98a-04c6e4bb0c96 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:09.887304 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:09.970445 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46452543-1f62-4af8-9515-b376fd876263 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:09.979863 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76843fb2-c075-4dd2-a98a-04c6e4bb0c96 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:10.008527 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a3bd9-6d70-4114-bd1b-e681585ff7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:10.009694 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a3bd9-6d70-4114-bd1b-e681585ff7a7 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:10.010229 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a3bd9-6d70-4114-bd1b-e681585ff7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:10.010706 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a3bd9-6d70-4114-bd1b-e681585ff7a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:10.011653 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a3bd9-6d70-4114-bd1b-e681585ff7a7 None admin] RBAC: Adding query filter params (role.id=c04b09acf4454802a88c34604ecd7e5a, scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2, user.id=21728de833c341a69d04b96062f285d3) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:10.012166 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a3bd9-6d70-4114-bd1b-e681585ff7a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:10.014757 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a3bd9-6d70-4114-bd1b-e681585ff7a7 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:10.018889 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79f28f-6453-4814-9041-725fbe019897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:10.019526 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79f28f-6453-4814-9041-725fbe019897 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:10.019792 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79f28f-6453-4814-9041-725fbe019897 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:10.020066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79f28f-6453-4814-9041-725fbe019897 None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:10.021263 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79f28f-6453-4814-9041-725fbe019897 None admin] RBAC: Authorizing `identity:get_project(project_id=a7643b24b47f42eab63dd25e22c5cdb2)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:10.023071 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79f28f-6453-4814-9041-725fbe019897 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:10.023176 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 70/134] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:46:09 2022] GET /identity/v3/role_assignments?user.id=21728de833c341a69d04b96062f285d3&scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2&role.id=c04b09acf4454802a88c34604ecd7e5a => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:10.024144 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a3bd9-6d70-4114-bd1b-e681585ff7a7 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:10.025348 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 65/135] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:09 2022] GET /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:10.041590 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79f28f-6453-4814-9041-725fbe019897 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:10.045339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:10.135545 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:10.147946 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a3bd9-6d70-4114-bd1b-e681585ff7a7 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:10.188757 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106be404-d9e2-4e6a-97cd-4b7509edfab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:10.189832 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106be404-d9e2-4e6a-97cd-4b7509edfab9 None admin] REQUEST_METHOD: `PUT` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:10.190345 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106be404-d9e2-4e6a-97cd-4b7509edfab9 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:10.190818 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106be404-d9e2-4e6a-97cd-4b7509edfab9 None admin] PATH_INFO: `/v3/projects/463bc96ad8dc489881f94d8a42c1770d/users/2887a095d202430d88cb368b25d74f6b/roles/ab06ca80774d48a191fece38e3f335ad` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:10.193320 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106be404-d9e2-4e6a-97cd-4b7509edfab9 None admin] RBAC: Authorizing `identity:create_grant(project_id=463bc96ad8dc489881f94d8a42c1770d, user_id=2887a095d202430d88cb368b25d74f6b, role_id=ab06ca80774d48a191fece38e3f335ad)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:10.195255 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106be404-d9e2-4e6a-97cd-4b7509edfab9 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:10.219031 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79f28f-6453-4814-9041-725fbe019897 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:10.225701 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 71/136] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 17 14:46:10 2022] PUT /identity/v3/projects/463bc96ad8dc489881f94d8a42c1770d/users/2887a095d202430d88cb368b25d74f6b/roles/ab06ca80774d48a191fece38e3f335ad => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:46:10.280009 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bc181-3d6a-4c47-8d8e-fe929339dbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:10.280751 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bc181-3d6a-4c47-8d8e-fe929339dbbc None admin] REQUEST_METHOD: `PUT` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:10.281078 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bc181-3d6a-4c47-8d8e-fe929339dbbc None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:10.281362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bc181-3d6a-4c47-8d8e-fe929339dbbc None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2/users/2887a095d202430d88cb368b25d74f6b/roles/df9fac15c20d418187fbaf38acafd61f` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:10.286186 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7bc181-3d6a-4c47-8d8e-fe929339dbbc None admin] RBAC: Authorizing `identity:create_grant(project_id=a7643b24b47f42eab63dd25e22c5cdb2, user_id=2887a095d202430d88cb368b25d74f6b, role_id=df9fac15c20d418187fbaf38acafd61f)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:10.287794 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7bc181-3d6a-4c47-8d8e-fe929339dbbc None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:10.308119 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 66/137] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 17 14:46:10 2022] PUT /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2/users/2887a095d202430d88cb368b25d74f6b/roles/df9fac15c20d418187fbaf38acafd61f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:46:10.839080 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfad27-e04c-4feb-a829-8dc3b2416ba0 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:10.839589 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfad27-e04c-4feb-a829-8dc3b2416ba0 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:10.839589 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfad27-e04c-4feb-a829-8dc3b2416ba0 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:10.841025 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 72/138] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:10.846879 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcb0b6-4fff-46f7-97ec-16b8b0db7cf4 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:10.847190 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcb0b6-4fff-46f7-97ec-16b8b0db7cf4 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:10.847441 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcb0b6-4fff-46f7-97ec-16b8b0db7cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:10.868068 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-85dcb0b6-4fff-46f7-97ec-16b8b0db7cf4 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:10.869306 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-85dcb0b6-4fff-46f7-97ec-16b8b0db7cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:10.958756 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:10.971421 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 67/139] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:11.014165 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01294e3b-ec96-43d6-9a49-82177fa11a1f None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:11.014377 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01294e3b-ec96-43d6-9a49-82177fa11a1f None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:11.014583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01294e3b-ec96-43d6-9a49-82177fa11a1f None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:11.015920 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 73/140] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:11.021212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f88a37-9d1d-4d22-a839-a05cdc03c8b5 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:11.021504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f88a37-9d1d-4d22-a839-a05cdc03c8b5 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:11.021803 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f88a37-9d1d-4d22-a839-a05cdc03c8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:11.046751 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-49f88a37-9d1d-4d22-a839-a05cdc03c8b5 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:11.047985 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-49f88a37-9d1d-4d22-a839-a05cdc03c8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:11.152071 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 68/141] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:11.428126 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01294e3b-ec96-43d6-9a49-82177fa11a1f None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:11.568213 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01294e3b-ec96-43d6-9a49-82177fa11a1f None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:11.602718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba03cc6-642c-476c-b6bc-c96b9c7523f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:11.603340 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba03cc6-642c-476c-b6bc-c96b9c7523f7 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:11.603614 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba03cc6-642c-476c-b6bc-c96b9c7523f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:11.603891 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba03cc6-642c-476c-b6bc-c96b9c7523f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:11.604976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba03cc6-642c-476c-b6bc-c96b9c7523f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:11.606422 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba03cc6-642c-476c-b6bc-c96b9c7523f7 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:11.608054 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 74/142] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:46:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:11.613664 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f88a37-9d1d-4d22-a839-a05cdc03c8b5 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:11.743989 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f88a37-9d1d-4d22-a839-a05cdc03c8b5 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:11.776966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:11.793133 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfa15c-9a09-403d-bc36-3809b95c3aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:11.793760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfa15c-9a09-403d-bc36-3809b95c3aee None admin] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:11.794123 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfa15c-9a09-403d-bc36-3809b95c3aee None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:11.794908 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfa15c-9a09-403d-bc36-3809b95c3aee None admin] PATH_INFO: `/v3/users` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:11.795635 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dfa15c-9a09-403d-bc36-3809b95c3aee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:11.797099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dfa15c-9a09-403d-bc36-3809b95c3aee None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:11.836569 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 69/143] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 17 14:46:11 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:46:11.852845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba03cc6-642c-476c-b6bc-c96b9c7523f7 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:11.888924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:11.984033 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba03cc6-642c-476c-b6bc-c96b9c7523f7 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:12.021624 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f02e75-c907-4b0d-babd-86c275f34fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:12.022209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f02e75-c907-4b0d-babd-86c275f34fbc None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:12.022490 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f02e75-c907-4b0d-babd-86c275f34fbc None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:12.022763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f02e75-c907-4b0d-babd-86c275f34fbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:12.036138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f02e75-c907-4b0d-babd-86c275f34fbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:12.041707 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-85f02e75-c907-4b0d-babd-86c275f34fbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:46:12.041707 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:12.041707 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:12.041707 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:12.041707 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:12.041707 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:12.041707 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:12.041707 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:12.041707 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:12.041707 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:12.041707 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:12.041707 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:12.041707 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:12.041707 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:12.041707 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:12.041707 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:12.042897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:12.042897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:12.042897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:12.042897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:12.042897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:12.042897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:12.042897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:12.042897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:12.042897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:12.042897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:12.042897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:12.042897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:12.042897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:12.042897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:12.042897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:12.042897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:12.043705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:12.043705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:12.043705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:12.043705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:12.043705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:12.043705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:12.043705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:12.043705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:12.043705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:12.043705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:12.043705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:46:12.043705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:46:12.043705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 75/144] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 17 14:46:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:12.049952 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfa15c-9a09-403d-bc36-3809b95c3aee None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:12.191026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfa15c-9a09-403d-bc36-3809b95c3aee None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:12.242878 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa9c54-eb80-44b0-b3f0-4ceb176a779b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:12.243502 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa9c54-eb80-44b0-b3f0-4ceb176a779b None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:12.243933 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa9c54-eb80-44b0-b3f0-4ceb176a779b None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:12.244213 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa9c54-eb80-44b0-b3f0-4ceb176a779b None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:12.244904 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa9c54-eb80-44b0-b3f0-4ceb176a779b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:12.245309 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa9c54-eb80-44b0-b3f0-4ceb176a779b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:12.250457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa9c54-eb80-44b0-b3f0-4ceb176a779b None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:12.260856 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 70/145] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:12.267197 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f02e75-c907-4b0d-babd-86c275f34fbc None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:12.355995 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:12.380842 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f02e75-c907-4b0d-babd-86c275f34fbc None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:12.415405 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9e4ca-c6c1-41f8-90b3-534085f1a68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:12.416038 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9e4ca-c6c1-41f8-90b3-534085f1a68a None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:12.416315 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9e4ca-c6c1-41f8-90b3-534085f1a68a None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:12.416583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9e4ca-c6c1-41f8-90b3-534085f1a68a None admin] PATH_INFO: `/v3/users/4b2dd9ba613b47b8b4618c0c2e6e4e48` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:12.417707 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9e4ca-c6c1-41f8-90b3-534085f1a68a None admin] RBAC: Authorizing `identity:get_user(user_id=4b2dd9ba613b47b8b4618c0c2e6e4e48)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:12.419692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9e4ca-c6c1-41f8-90b3-534085f1a68a None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:12.421566 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 76/146] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:12 2022] GET /identity/v3/users/4b2dd9ba613b47b8b4618c0c2e6e4e48 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:12.426943 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa9c54-eb80-44b0-b3f0-4ceb176a779b None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:12.473573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:12.545097 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa9c54-eb80-44b0-b3f0-4ceb176a779b None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:12.607891 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b4c5f-d9ea-46a4-912f-0fa4c7d9bc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:12.608847 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b4c5f-d9ea-46a4-912f-0fa4c7d9bc85 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:12.609335 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b4c5f-d9ea-46a4-912f-0fa4c7d9bc85 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:12.609849 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b4c5f-d9ea-46a4-912f-0fa4c7d9bc85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:12.695076 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b4c5f-d9ea-46a4-912f-0fa4c7d9bc85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:12.696876 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b4c5f-d9ea-46a4-912f-0fa4c7d9bc85 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:12.746719 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:12.819359 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 71/147] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:12.825113 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9e4ca-c6c1-41f8-90b3-534085f1a68a None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:12.960833 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9e4ca-c6c1-41f8-90b3-534085f1a68a None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:12.998047 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de075262-06b3-4bb4-9daa-32bd7c293aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:12.998986 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de075262-06b3-4bb4-9daa-32bd7c293aeb None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:12.999412 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de075262-06b3-4bb4-9daa-32bd7c293aeb None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:12.999832 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de075262-06b3-4bb4-9daa-32bd7c293aeb None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:13.001118 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de075262-06b3-4bb4-9daa-32bd7c293aeb None admin] RBAC: Authorizing `identity:get_project(project_id=a7643b24b47f42eab63dd25e22c5cdb2)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:13.002726 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de075262-06b3-4bb4-9daa-32bd7c293aeb None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:13.004901 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 77/148] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:12 2022] GET /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:13.010640 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b4c5f-d9ea-46a4-912f-0fa4c7d9bc85 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:13.167759 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b4c5f-d9ea-46a4-912f-0fa4c7d9bc85 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:13.210733 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8a39b-831f-4f57-9182-9a081d9d4ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:13.211409 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8a39b-831f-4f57-9182-9a081d9d4ff5 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:13.211649 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8a39b-831f-4f57-9182-9a081d9d4ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:13.211928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8a39b-831f-4f57-9182-9a081d9d4ff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:13.212677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8a39b-831f-4f57-9182-9a081d9d4ff5 None admin] RBAC: Adding query filter params (role.id=a307f157f2a445c7af8bd4fd41aa1c4b, scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2, user.id=4b2dd9ba613b47b8b4618c0c2e6e4e48) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:13.212986 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8a39b-831f-4f57-9182-9a081d9d4ff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:13.214455 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8a39b-831f-4f57-9182-9a081d9d4ff5 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:13.226536 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 72/149] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:46:13 2022] GET /identity/v3/role_assignments?user.id=4b2dd9ba613b47b8b4618c0c2e6e4e48&scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2&role.id=a307f157f2a445c7af8bd4fd41aa1c4b => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:13.239251 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249699e-a61f-4121-9ed7-799f3669a1d0 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:13.239577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249699e-a61f-4121-9ed7-799f3669a1d0 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:13.239809 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249699e-a61f-4121-9ed7-799f3669a1d0 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:13.241157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 78/150] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:13.247611 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e6d26-94dd-4385-9a20-0fb069bb3a1a None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:13.247921 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e6d26-94dd-4385-9a20-0fb069bb3a1a None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:13.248185 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e6d26-94dd-4385-9a20-0fb069bb3a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:13.258764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:13.274779 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-399e6d26-94dd-4385-9a20-0fb069bb3a1a None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:13.275995 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-399e6d26-94dd-4385-9a20-0fb069bb3a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:13.371321 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 73/151] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:13.653125 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146844e-b0e5-4c2e-b368-7ac883e5d936 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:13.653537 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146844e-b0e5-4c2e-b368-7ac883e5d936 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:13.653874 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146844e-b0e5-4c2e-b368-7ac883e5d936 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:13.655351 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 79/152] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:13.662868 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaf1a1-b4c7-439b-b788-fd0ac5f80930 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:13.663146 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaf1a1-b4c7-439b-b788-fd0ac5f80930 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:13.663429 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaf1a1-b4c7-439b-b788-fd0ac5f80930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:13.685097 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-5fcaf1a1-b4c7-439b-b788-fd0ac5f80930 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:13.686853 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-5fcaf1a1-b4c7-439b-b788-fd0ac5f80930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:13.769599 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 74/153] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:13.803363 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c730892-c379-45b4-b0fa-0526f90ab9b6 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:13.803551 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c730892-c379-45b4-b0fa-0526f90ab9b6 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:13.803824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c730892-c379-45b4-b0fa-0526f90ab9b6 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:13.805478 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 80/154] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:13.812033 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8d1c-0e0d-4de3-9055-d960661ac0fb None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:13.812321 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8d1c-0e0d-4de3-9055-d960661ac0fb None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:13.812585 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8d1c-0e0d-4de3-9055-d960661ac0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:13.832675 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-f6cf8d1c-0e0d-4de3-9055-d960661ac0fb None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:13.833874 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-f6cf8d1c-0e0d-4de3-9055-d960661ac0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:13.909984 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:13.923870 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 75/155] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:13.992606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ad9ad-a320-4751-b245-2e6e2fd653a7 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:13.993118 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ad9ad-a320-4751-b245-2e6e2fd653a7 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:13.993198 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ad9ad-a320-4751-b245-2e6e2fd653a7 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:13.994654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 81/156] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:13.998260 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf8d1c-0e0d-4de3-9055-d960661ac0fb None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:14.000800 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726652b-cca5-47e3-bd73-b9e49124ab80 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:14.001086 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726652b-cca5-47e3-bd73-b9e49124ab80 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:14.001365 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726652b-cca5-47e3-bd73-b9e49124ab80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:14.027112 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-b726652b-cca5-47e3-bd73-b9e49124ab80 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:14.028878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-b726652b-cca5-47e3-bd73-b9e49124ab80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:14.045902 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:14.183947 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf8d1c-0e0d-4de3-9055-d960661ac0fb None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:14.189711 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 82/157] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:46:14.253662 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d757d9-3b46-4df6-8a29-650c2dd264a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:14.254720 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d757d9-3b46-4df6-8a29-650c2dd264a0 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:14.255263 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d757d9-3b46-4df6-8a29-650c2dd264a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:14.255746 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d757d9-3b46-4df6-8a29-650c2dd264a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:14.278700 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d757d9-3b46-4df6-8a29-650c2dd264a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:14.289755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-28d757d9-3b46-4df6-8a29-650c2dd264a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:14.289755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:14.289755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:14.289755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:14.289755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:14.289755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:14.289755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:14.289755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:14.289755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:14.289755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:14.289755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:14.289755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:14.289755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:14.289755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:14.289755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:14.289755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:14.290601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:14.290601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:14.290601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:14.290601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:14.290601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:14.290601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:14.290601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:14.290601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:14.290601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:14.290601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:14.290601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:14.290601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:14.290601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:14.290601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:14.290601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:14.290601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:14.291351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:14.291351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:14.291351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:14.291351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:14.291351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:14.291351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:14.291351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:14.291351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:14.291351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:14.291351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:14.291351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:14.291351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:14.297270 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 76/158] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:14.302742 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726652b-cca5-47e3-bd73-b9e49124ab80 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:14.350609 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d757d9-3b46-4df6-8a29-650c2dd264a0 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:14.473137 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726652b-cca5-47e3-bd73-b9e49124ab80 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:14.485235 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:14.525579 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05162d45-fbae-43ea-8f2b-370b884b1ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:14.526238 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05162d45-fbae-43ea-8f2b-370b884b1ce6 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:14.526520 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05162d45-fbae-43ea-8f2b-370b884b1ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:14.526794 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05162d45-fbae-43ea-8f2b-370b884b1ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:14.527477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05162d45-fbae-43ea-8f2b-370b884b1ce6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:14.527782 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05162d45-fbae-43ea-8f2b-370b884b1ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:14.529177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05162d45-fbae-43ea-8f2b-370b884b1ce6 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:14.538414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 83/159] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:14.544874 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05162d45-fbae-43ea-8f2b-370b884b1ce6 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:14.569260 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:14.597112 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d757d9-3b46-4df6-8a29-650c2dd264a0 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:14.661903 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19d389-5d45-4371-9f05-fbfda0f2a4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:14.662542 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19d389-5d45-4371-9f05-fbfda0f2a4b0 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:14.662827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19d389-5d45-4371-9f05-fbfda0f2a4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:14.664352 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19d389-5d45-4371-9f05-fbfda0f2a4b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:14.686915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19d389-5d45-4371-9f05-fbfda0f2a4b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:14.692091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-2c19d389-5d45-4371-9f05-fbfda0f2a4b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:46:14.692091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:14.692091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:14.692091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:14.692091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:14.692091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:14.692091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:14.692091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:14.692091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:14.692091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:14.692091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:14.692091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:14.692091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:14.692091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:14.692091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:14.692091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:14.693079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:14.693079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:14.693079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:14.693079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:14.693079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:14.693079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:14.693079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:14.693079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:14.693079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:14.693079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:14.693079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:14.693079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:14.693079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:14.693079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:14.693079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:14.693079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:14.693857 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:14.693857 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:14.693857 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:14.693857 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:14.693857 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:14.693857 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:14.693857 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:14.693857 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:14.693857 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:14.693857 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:14.693857 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:46:14.693857 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:14.698306 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 77/160] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:14.699162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19d389-5d45-4371-9f05-fbfda0f2a4b0 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:14.794845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05162d45-fbae-43ea-8f2b-370b884b1ce6 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:14.869348 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef494793-cb4f-42dc-8221-54582893bd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:14.870361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef494793-cb4f-42dc-8221-54582893bd2f None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:14.870837 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef494793-cb4f-42dc-8221-54582893bd2f None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:14.871630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef494793-cb4f-42dc-8221-54582893bd2f None admin] PATH_INFO: `/v3/users/2887a095d202430d88cb368b25d74f6b` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:14.874538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef494793-cb4f-42dc-8221-54582893bd2f None admin] RBAC: Authorizing `identity:get_user(user_id=2887a095d202430d88cb368b25d74f6b)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:14.876246 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef494793-cb4f-42dc-8221-54582893bd2f None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:14.881142 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 84/161] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:14 2022] GET /identity/v3/users/2887a095d202430d88cb368b25d74f6b => generated 275 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:14.882283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef494793-cb4f-42dc-8221-54582893bd2f None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:14.928004 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19d389-5d45-4371-9f05-fbfda0f2a4b0 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:14.956172 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:14.999532 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb144647-7ebf-4d12-a13e-626baf072465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:15.000162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb144647-7ebf-4d12-a13e-626baf072465 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:15.000441 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb144647-7ebf-4d12-a13e-626baf072465 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:15.000711 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb144647-7ebf-4d12-a13e-626baf072465 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:15.023647 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb144647-7ebf-4d12-a13e-626baf072465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:15.028570 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-bb144647-7ebf-4d12-a13e-626baf072465 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:15.028570 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:15.028570 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:15.028570 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:15.028570 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:15.028570 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:15.028570 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:15.028570 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:15.028570 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:15.028570 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:15.028570 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:15.028570 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:15.028570 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:15.028570 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:15.028570 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:15.028570 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:15.029771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:15.029771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:15.029771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:15.029771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:15.029771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:15.029771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:15.029771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:15.029771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:15.029771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:15.029771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:15.029771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:15.029771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:15.029771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:15.029771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:15.029771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:15.029771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:15.030548 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:15.030548 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:15.030548 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:15.030548 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:15.030548 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:15.030548 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:15.030548 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:15.030548 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:15.030548 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:15.030548 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:15.030548 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:15.030548 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:15.030548 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 78/162] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:15.032458 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb144647-7ebf-4d12-a13e-626baf072465 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:15.035142 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:15.095822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef494793-cb4f-42dc-8221-54582893bd2f None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:15.171587 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc433d52-3117-4ea6-8f41-b62be6715b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:15.172205 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc433d52-3117-4ea6-8f41-b62be6715b31 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:15.172484 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc433d52-3117-4ea6-8f41-b62be6715b31 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:15.172756 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc433d52-3117-4ea6-8f41-b62be6715b31 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:15.173435 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc433d52-3117-4ea6-8f41-b62be6715b31 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:15.173755 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc433d52-3117-4ea6-8f41-b62be6715b31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:15.175128 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc433d52-3117-4ea6-8f41-b62be6715b31 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:15.193066 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 85/163] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:15.193775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc433d52-3117-4ea6-8f41-b62be6715b31 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:15.199628 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb144647-7ebf-4d12-a13e-626baf072465 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:15.274929 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ae272-4222-4a03-bf80-b5f1665e0dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:15.275617 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ae272-4222-4a03-bf80-b5f1665e0dfe None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:15.275895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ae272-4222-4a03-bf80-b5f1665e0dfe None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:15.276164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ae272-4222-4a03-bf80-b5f1665e0dfe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:15.301469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ae272-4222-4a03-bf80-b5f1665e0dfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:15.307638 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-8d5ae272-4222-4a03-bf80-b5f1665e0dfe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:15.307638 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:15.307638 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:15.307638 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:15.307638 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:15.307638 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:15.307638 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:15.307638 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:15.307638 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:15.307638 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:15.307638 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:15.307638 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:15.307638 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:15.307638 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:15.307638 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:15.307638 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:15.308710 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:15.308710 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:15.308710 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:15.308710 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:15.308710 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:15.308710 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:15.308710 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:15.308710 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:15.308710 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:15.308710 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:15.308710 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:15.308710 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:15.308710 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:15.308710 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:15.308710 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:15.308710 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:15.309466 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:15.309466 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:15.309466 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:15.309466 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:15.309466 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:15.309466 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:15.309466 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:15.309466 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:15.309466 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:15.309466 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:15.309466 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:15.309466 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:15.309466 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 79/164] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:46:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:15.311219 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ae272-4222-4a03-bf80-b5f1665e0dfe None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:15.381042 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:15.398839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc433d52-3117-4ea6-8f41-b62be6715b31 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:15.474550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff30406-0b88-4287-902f-ae9390dcce23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:15.475265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff30406-0b88-4287-902f-ae9390dcce23 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:15.475555 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff30406-0b88-4287-902f-ae9390dcce23 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:15.475825 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff30406-0b88-4287-902f-ae9390dcce23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:15.477842 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ae272-4222-4a03-bf80-b5f1665e0dfe None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:15.485367 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:15.518302 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ffcbef-4243-4020-8491-3fe27ae9b50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:15.519035 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffcbef-4243-4020-8491-3fe27ae9b50c None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:15.519314 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffcbef-4243-4020-8491-3fe27ae9b50c None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:15.519587 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffcbef-4243-4020-8491-3fe27ae9b50c None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:15.520318 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ffcbef-4243-4020-8491-3fe27ae9b50c None admin] RBAC: Adding query filter params (name=member) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:15.520625 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ffcbef-4243-4020-8491-3fe27ae9b50c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:15.522026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ffcbef-4243-4020-8491-3fe27ae9b50c None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:15.531828 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 80/165] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:15.532764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ffcbef-4243-4020-8491-3fe27ae9b50c None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:15.628042 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff30406-0b88-4287-902f-ae9390dcce23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:15.629561 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff30406-0b88-4287-902f-ae9390dcce23 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:15.652519 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:15.659485 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ffcbef-4243-4020-8491-3fe27ae9b50c None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:15.696556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14cf3a-7462-47cf-b28d-a45f0955e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:15.697282 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14cf3a-7462-47cf-b28d-a45f0955e7ca None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:15.697573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14cf3a-7462-47cf-b28d-a45f0955e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:15.697888 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14cf3a-7462-47cf-b28d-a45f0955e7ca None admin] PATH_INFO: `/v3/users/21728de833c341a69d04b96062f285d3` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:15.699142 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14cf3a-7462-47cf-b28d-a45f0955e7ca None admin] RBAC: Authorizing `identity:get_user(user_id=21728de833c341a69d04b96062f285d3)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:15.700751 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14cf3a-7462-47cf-b28d-a45f0955e7ca None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:15.702489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 81/166] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:15 2022] GET /identity/v3/users/21728de833c341a69d04b96062f285d3 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:15.703268 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14cf3a-7462-47cf-b28d-a45f0955e7ca None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:15.812837 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14cf3a-7462-47cf-b28d-a45f0955e7ca None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:15.849223 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d910c-8412-4412-9623-be5cb9a2123f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:15.849952 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d910c-8412-4412-9623-be5cb9a2123f None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:15.850240 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d910c-8412-4412-9623-be5cb9a2123f None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:15.850601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d910c-8412-4412-9623-be5cb9a2123f None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:15.851289 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d910c-8412-4412-9623-be5cb9a2123f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:15.851597 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d910c-8412-4412-9623-be5cb9a2123f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:15.853256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d910c-8412-4412-9623-be5cb9a2123f None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:15.862519 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 86/167] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:15.863462 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff30406-0b88-4287-902f-ae9390dcce23 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:15.864514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 82/168] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:46:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:15.865711 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d910c-8412-4412-9623-be5cb9a2123f None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:15.910221 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:15.940350 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:15.986443 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d910c-8412-4412-9623-be5cb9a2123f None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:16.024981 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feaa05c-e43b-4256-8ee4-3071da712eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:16.026064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaa05c-e43b-4256-8ee4-3071da712eb5 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:16.026484 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaa05c-e43b-4256-8ee4-3071da712eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:16.026895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaa05c-e43b-4256-8ee4-3071da712eb5 None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:16.029082 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feaa05c-e43b-4256-8ee4-3071da712eb5 None admin] RBAC: Authorizing `identity:get_project(project_id=a7643b24b47f42eab63dd25e22c5cdb2)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:16.030852 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feaa05c-e43b-4256-8ee4-3071da712eb5 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:16.032665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 83/169] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:15 2022] GET /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:16.033646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feaa05c-e43b-4256-8ee4-3071da712eb5 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:16.048431 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff30406-0b88-4287-902f-ae9390dcce23 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:16.116358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f35d75-aa48-4e53-9fa5-d4f8501f4c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:16.117000 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f35d75-aa48-4e53-9fa5-d4f8501f4c53 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:16.117274 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f35d75-aa48-4e53-9fa5-d4f8501f4c53 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:16.117548 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f35d75-aa48-4e53-9fa5-d4f8501f4c53 None admin] PATH_INFO: `/v3/users/2887a095d202430d88cb368b25d74f6b` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:16.122564 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f35d75-aa48-4e53-9fa5-d4f8501f4c53 None admin] RBAC: Authorizing `identity:get_user(user_id=2887a095d202430d88cb368b25d74f6b)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:16.123920 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f35d75-aa48-4e53-9fa5-d4f8501f4c53 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:16.125532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 87/170] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:15 2022] GET /identity/v3/users/2887a095d202430d88cb368b25d74f6b => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:16.126409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f35d75-aa48-4e53-9fa5-d4f8501f4c53 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:16.143221 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:16.151442 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feaa05c-e43b-4256-8ee4-3071da712eb5 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:16.189325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7904f-9986-44ae-b498-29bf6b09b0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:16.189918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7904f-9986-44ae-b498-29bf6b09b0f6 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:16.190194 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7904f-9986-44ae-b498-29bf6b09b0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:16.190462 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7904f-9986-44ae-b498-29bf6b09b0f6 None admin] PATH_INFO: `/v3/users/2887a095d202430d88cb368b25d74f6b` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:16.191610 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7904f-9986-44ae-b498-29bf6b09b0f6 None admin] RBAC: Authorizing `identity:get_user(user_id=2887a095d202430d88cb368b25d74f6b)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:16.193054 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7904f-9986-44ae-b498-29bf6b09b0f6 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:16.194724 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 84/171] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:16 2022] GET /identity/v3/users/2887a095d202430d88cb368b25d74f6b => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:16.199675 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7904f-9986-44ae-b498-29bf6b09b0f6 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:16.272263 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f35d75-aa48-4e53-9fa5-d4f8501f4c53 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:16.282411 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:16.318958 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d5177-bd73-40d7-8fb4-982e3918c475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:16.320162 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d5177-bd73-40d7-8fb4-982e3918c475 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:16.320544 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d5177-bd73-40d7-8fb4-982e3918c475 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:16.320909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d5177-bd73-40d7-8fb4-982e3918c475 None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:16.322440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d5177-bd73-40d7-8fb4-982e3918c475 None admin] RBAC: Authorizing `identity:get_project(project_id=a7643b24b47f42eab63dd25e22c5cdb2)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:16.323739 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7904f-9986-44ae-b498-29bf6b09b0f6 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:16.324310 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d5177-bd73-40d7-8fb4-982e3918c475 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:16.328446 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 88/172] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:16 2022] GET /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:16.329354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d5177-bd73-40d7-8fb4-982e3918c475 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:16.377437 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9abe97-dd69-467c-a99e-766117279921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:16.378360 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9abe97-dd69-467c-a99e-766117279921 None admin] REQUEST_METHOD: `PUT` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:16.378811 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9abe97-dd69-467c-a99e-766117279921 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:16.379086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9abe97-dd69-467c-a99e-766117279921 None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2/users/21728de833c341a69d04b96062f285d3/roles/c04b09acf4454802a88c34604ecd7e5a` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:16.381030 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9abe97-dd69-467c-a99e-766117279921 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7643b24b47f42eab63dd25e22c5cdb2, user_id=21728de833c341a69d04b96062f285d3, role_id=c04b09acf4454802a88c34604ecd7e5a)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:16.382530 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9abe97-dd69-467c-a99e-766117279921 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:16.398547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 85/173] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 17 14:46:16 2022] PUT /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2/users/21728de833c341a69d04b96062f285d3/roles/c04b09acf4454802a88c34604ecd7e5a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:46:16.399863 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3c41f-2a53-4b0b-a19e-e277b2ff0834 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:16.400157 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3c41f-2a53-4b0b-a19e-e277b2ff0834 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:16.400432 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3c41f-2a53-4b0b-a19e-e277b2ff0834 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:16.403857 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 86/174] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:16.403857 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3c41f-2a53-4b0b-a19e-e277b2ff0834 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:16.442071 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:16.460469 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d5177-bd73-40d7-8fb4-982e3918c475 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:16.512497 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772ce17-3c1c-4925-956a-227b2b344902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:16.514338 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772ce17-3c1c-4925-956a-227b2b344902 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:16.514834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772ce17-3c1c-4925-956a-227b2b344902 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:16.515590 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772ce17-3c1c-4925-956a-227b2b344902 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:16.560464 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3c41f-2a53-4b0b-a19e-e277b2ff0834 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:16.587265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:16.599054 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7ba1d-0cda-4443-ae29-6443355095a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:16.599653 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7ba1d-0cda-4443-ae29-6443355095a1 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:16.599935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7ba1d-0cda-4443-ae29-6443355095a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:16.600230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7ba1d-0cda-4443-ae29-6443355095a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:16.617430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772ce17-3c1c-4925-956a-227b2b344902 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:16.619157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772ce17-3c1c-4925-956a-227b2b344902 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:16.695851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7ba1d-0cda-4443-ae29-6443355095a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:16.697722 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7ba1d-0cda-4443-ae29-6443355095a1 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:16.724665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:16.734944 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 89/175] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:16.737915 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772ce17-3c1c-4925-956a-227b2b344902 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:16.821690 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:16.825378 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 87/176] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:16.827862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5cd6e-4016-4e9a-b5e9-c80784cc0eca None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:16.828140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5cd6e-4016-4e9a-b5e9-c80784cc0eca None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:16.828405 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5cd6e-4016-4e9a-b5e9-c80784cc0eca None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:16.830037 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 88/177] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:16.830895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b90689-af47-4f97-9c6c-a9cc7f8eb238 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:16.831169 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b90689-af47-4f97-9c6c-a9cc7f8eb238 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:16.831505 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b90689-af47-4f97-9c6c-a9cc7f8eb238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:16.850774 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-c9b90689-af47-4f97-9c6c-a9cc7f8eb238 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:16.850959 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772ce17-3c1c-4925-956a-227b2b344902 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:16.851945 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-c9b90689-af47-4f97-9c6c-a9cc7f8eb238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:16.887964 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf5112-e65d-480c-950d-9a01040cd198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:16.888572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf5112-e65d-480c-950d-9a01040cd198 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:16.888851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf5112-e65d-480c-950d-9a01040cd198 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:16.889120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf5112-e65d-480c-950d-9a01040cd198 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:16.889886 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf5112-e65d-480c-950d-9a01040cd198 None admin] RBAC: Adding query filter params (role.id=ab06ca80774d48a191fece38e3f335ad, scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2, user.id=2887a095d202430d88cb368b25d74f6b) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:16.890200 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf5112-e65d-480c-950d-9a01040cd198 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:16.891657 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf5112-e65d-480c-950d-9a01040cd198 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:16.897398 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 90/178] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:46:16 2022] GET /identity/v3/role_assignments?user.id=2887a095d202430d88cb368b25d74f6b&scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2&role.id=ab06ca80774d48a191fece38e3f335ad => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:16.898228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf5112-e65d-480c-950d-9a01040cd198 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:16.938711 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 89/179] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:16.946101 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cad62-c9b4-4887-9bd1-69fcc0bfdb34 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:16.946676 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cad62-c9b4-4887-9bd1-69fcc0bfdb34 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:16.947092 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cad62-c9b4-4887-9bd1-69fcc0bfdb34 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:16.948707 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 90/180] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:16.949611 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cad62-c9b4-4887-9bd1-69fcc0bfdb34 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:17.058753 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:17.099929 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf5112-e65d-480c-950d-9a01040cd198 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:17.116205 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cad62-c9b4-4887-9bd1-69fcc0bfdb34 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:17.149209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cea404-6945-449d-b54c-d23703043628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:17.150007 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cea404-6945-449d-b54c-d23703043628 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:17.150287 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cea404-6945-449d-b54c-d23703043628 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:17.150556 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cea404-6945-449d-b54c-d23703043628 None admin] PATH_INFO: `/v3/projects/463bc96ad8dc489881f94d8a42c1770d` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:17.154511 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cea404-6945-449d-b54c-d23703043628 None admin] RBAC: Authorizing `identity:get_project(project_id=463bc96ad8dc489881f94d8a42c1770d)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:17.155977 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cea404-6945-449d-b54c-d23703043628 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:17.157868 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 91/181] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:16 2022] GET /identity/v3/projects/463bc96ad8dc489881f94d8a42c1770d => generated 312 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:17.158853 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e25a1b-50db-4004-bdd3-5792744bc01f None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:17.159249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e25a1b-50db-4004-bdd3-5792744bc01f None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:17.159723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e25a1b-50db-4004-bdd3-5792744bc01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:17.177626 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:17.188414 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91367b3b-e2b6-4e2c-99c6-db32cb732b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:17.189057 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91367b3b-e2b6-4e2c-99c6-db32cb732b42 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:17.189335 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91367b3b-e2b6-4e2c-99c6-db32cb732b42 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:17.189604 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91367b3b-e2b6-4e2c-99c6-db32cb732b42 None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:17.191496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91367b3b-e2b6-4e2c-99c6-db32cb732b42 None admin] RBAC: Authorizing `identity:get_project(project_id=a7643b24b47f42eab63dd25e22c5cdb2)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:17.192974 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91367b3b-e2b6-4e2c-99c6-db32cb732b42 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:17.194649 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 91/182] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:16 2022] GET /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:17.194939 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-d3e25a1b-50db-4004-bdd3-5792744bc01f None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:17.195820 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48b3e9-4e0c-4818-8350-ec4fb2318a94 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:17.196158 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48b3e9-4e0c-4818-8350-ec4fb2318a94 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:17.196372 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48b3e9-4e0c-4818-8350-ec4fb2318a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:17.197019 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-d3e25a1b-50db-4004-bdd3-5792744bc01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:17.226287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-9c48b3e9-4e0c-4818-8350-ec4fb2318a94 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:17.227190 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-9c48b3e9-4e0c-4818-8350-ec4fb2318a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:17.281429 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 92/183] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:17.282680 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e25a1b-50db-4004-bdd3-5792744bc01f None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:17.302762 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 92/184] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:17.303617 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48b3e9-4e0c-4818-8350-ec4fb2318a94 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:17.360084 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:17.398134 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e25a1b-50db-4004-bdd3-5792744bc01f None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:17.417380 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48b3e9-4e0c-4818-8350-ec4fb2318a94 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:17.460582 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf0ace-dca6-46a7-b17d-aca41a46a5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:17.461189 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf0ace-dca6-46a7-b17d-aca41a46a5ae None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:17.461467 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf0ace-dca6-46a7-b17d-aca41a46a5ae None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:17.461754 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf0ace-dca6-46a7-b17d-aca41a46a5ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:17.462487 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf0ace-dca6-46a7-b17d-aca41a46a5ae None admin] RBAC: Adding query filter params (role.id=ab06ca80774d48a191fece38e3f335ad, scope.project.id=463bc96ad8dc489881f94d8a42c1770d, user.id=2887a095d202430d88cb368b25d74f6b) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:17.462792 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf0ace-dca6-46a7-b17d-aca41a46a5ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:17.464223 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf0ace-dca6-46a7-b17d-aca41a46a5ae None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:17.469959 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:17.470843 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a5b70-c07b-4c3e-99a1-fb137c85a3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:17.471442 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a5b70-c07b-4c3e-99a1-fb137c85a3ea None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:17.471718 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a5b70-c07b-4c3e-99a1-fb137c85a3ea None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:17.471986 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a5b70-c07b-4c3e-99a1-fb137c85a3ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:17.472726 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a5b70-c07b-4c3e-99a1-fb137c85a3ea None admin] RBAC: Adding query filter params (role.id=df9fac15c20d418187fbaf38acafd61f, scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2, user.id=2887a095d202430d88cb368b25d74f6b) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:17.473030 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a5b70-c07b-4c3e-99a1-fb137c85a3ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:17.474464 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a5b70-c07b-4c3e-99a1-fb137c85a3ea None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:17.480067 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 93/185] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:46:17 2022] GET /identity/v3/role_assignments?user.id=2887a095d202430d88cb368b25d74f6b&scope.project.id=463bc96ad8dc489881f94d8a42c1770d&role.id=ab06ca80774d48a191fece38e3f335ad => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:17.480883 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf0ace-dca6-46a7-b17d-aca41a46a5ae None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:17.496283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 93/186] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:46:17 2022] GET /identity/v3/role_assignments?user.id=2887a095d202430d88cb368b25d74f6b&scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2&role.id=df9fac15c20d418187fbaf38acafd61f => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:17.654288 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf0ace-dca6-46a7-b17d-aca41a46a5ae None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:17.706133 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b2af3-7026-4317-8268-66b65d6932f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:17.707227 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b2af3-7026-4317-8268-66b65d6932f7 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:17.707708 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b2af3-7026-4317-8268-66b65d6932f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:17.708173 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b2af3-7026-4317-8268-66b65d6932f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:17.726124 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b2af3-7026-4317-8268-66b65d6932f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:17.732501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-ed7b2af3-7026-4317-8268-66b65d6932f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:46:17.732501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:17.732501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:17.732501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:17.732501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:17.732501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:17.732501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:17.732501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:17.732501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:17.732501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:17.732501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:17.732501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:17.732501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:17.732501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:17.732501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:17.732501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:17.733579 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:17.733579 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:17.733579 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:17.733579 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:17.733579 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:17.733579 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:17.733579 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:17.733579 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:17.733579 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:17.733579 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:17.733579 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:17.733579 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:17.733579 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:17.733579 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:17.733579 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:17.733579 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:17.734404 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:17.734404 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:17.734404 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:17.734404 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:17.734404 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:17.734404 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:17.734404 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:17.734404 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:17.734404 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:17.734404 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:17.734404 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:46:17.734404 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:46:17.737439 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 94/187] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 17 14:46:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:17.743231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a5b70-c07b-4c3e-99a1-fb137c85a3ea None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:17.764429 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b2af3-7026-4317-8268-66b65d6932f7 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:17.868490 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:17.922761 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a5b70-c07b-4c3e-99a1-fb137c85a3ea None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:17.929691 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b2af3-7026-4317-8268-66b65d6932f7 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:17.937984 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:17.962040 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473e97e-535c-465b-886e-0eb7fc899b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:17.962541 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473e97e-535c-465b-886e-0eb7fc899b67 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:17.962812 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473e97e-535c-465b-886e-0eb7fc899b67 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:17.963080 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473e97e-535c-465b-886e-0eb7fc899b67 None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:17.963752 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473e97e-535c-465b-886e-0eb7fc899b67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:17.964051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473e97e-535c-465b-886e-0eb7fc899b67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:17.965464 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473e97e-535c-465b-886e-0eb7fc899b67 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:17.974147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2e8aa-7ef0-4083-a5e5-1a652af56a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:17.974864 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2e8aa-7ef0-4083-a5e5-1a652af56a04 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:17.975368 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 94/188] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:17.975484 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2e8aa-7ef0-4083-a5e5-1a652af56a04 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:17.975484 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2e8aa-7ef0-4083-a5e5-1a652af56a04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:17.976250 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473e97e-535c-465b-886e-0eb7fc899b67 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:18.000002 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2e8aa-7ef0-4083-a5e5-1a652af56a04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:18.004834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-e9f2e8aa-7ef0-4083-a5e5-1a652af56a04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:18.004834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:18.004834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:18.004834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:18.004834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:18.004834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:18.004834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:18.004834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:18.004834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:18.004834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:18.004834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:18.004834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:18.004834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:18.004834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:18.004834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:18.004834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:18.005984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:18.005984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:18.005984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:18.005984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:18.005984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:18.005984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:18.005984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:18.005984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:18.005984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:18.005984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:18.005984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:18.005984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:18.005984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:18.005984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:18.005984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:18.005984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:18.006965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:18.006965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:18.006965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:18.006965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:18.006965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:18.006965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:18.006965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:18.006965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:18.006965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:18.006965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:18.006965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:18.006965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:46:18.006965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 95/189] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:46:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:18.007769 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2e8aa-7ef0-4083-a5e5-1a652af56a04 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:18.093684 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473e97e-535c-465b-886e-0eb7fc899b67 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:18.124344 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2e8aa-7ef0-4083-a5e5-1a652af56a04 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:18.132659 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58211b-dfc4-4172-a45e-77b234e8891c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:18.133280 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58211b-dfc4-4172-a45e-77b234e8891c None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:18.133557 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58211b-dfc4-4172-a45e-77b234e8891c None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:18.133848 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58211b-dfc4-4172-a45e-77b234e8891c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:18.134962 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58211b-dfc4-4172-a45e-77b234e8891c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:18.136390 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58211b-dfc4-4172-a45e-77b234e8891c None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:18.139109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 95/190] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:46:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:18.142413 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58211b-dfc4-4172-a45e-77b234e8891c None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:18.148999 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:18.167168 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc32d3f-e1f0-48ff-8cdf-3f38e504d1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:18.167792 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc32d3f-e1f0-48ff-8cdf-3f38e504d1bd None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:18.168317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc32d3f-e1f0-48ff-8cdf-3f38e504d1bd None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:18.168591 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc32d3f-e1f0-48ff-8cdf-3f38e504d1bd None admin] PATH_INFO: `/v3/users/d47c0b5f096e4cb399d5f8047cde151c` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:18.185613 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc32d3f-e1f0-48ff-8cdf-3f38e504d1bd None admin] RBAC: Authorizing `identity:get_user(user_id=d47c0b5f096e4cb399d5f8047cde151c)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:18.187213 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc32d3f-e1f0-48ff-8cdf-3f38e504d1bd None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:18.193389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 96/191] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:18 2022] GET /identity/v3/users/d47c0b5f096e4cb399d5f8047cde151c => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:18.193389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc32d3f-e1f0-48ff-8cdf-3f38e504d1bd None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:18.200345 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:18.255545 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58211b-dfc4-4172-a45e-77b234e8891c None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:18.289401 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92801772-8a49-42d5-9b13-213a3faa33c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:18.290030 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92801772-8a49-42d5-9b13-213a3faa33c7 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:18.290307 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92801772-8a49-42d5-9b13-213a3faa33c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:18.290605 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92801772-8a49-42d5-9b13-213a3faa33c7 None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:18.291261 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92801772-8a49-42d5-9b13-213a3faa33c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:18.291561 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92801772-8a49-42d5-9b13-213a3faa33c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:18.292919 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92801772-8a49-42d5-9b13-213a3faa33c7 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:18.297179 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc32d3f-e1f0-48ff-8cdf-3f38e504d1bd None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:18.301864 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 96/192] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:46:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:18.301864 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92801772-8a49-42d5-9b13-213a3faa33c7 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:18.337973 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40d62a-a7ab-4212-aeea-6698d6b6d249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:18.338584 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40d62a-a7ab-4212-aeea-6698d6b6d249 None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:18.338866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40d62a-a7ab-4212-aeea-6698d6b6d249 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:18.339141 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40d62a-a7ab-4212-aeea-6698d6b6d249 None admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:18.339783 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40d62a-a7ab-4212-aeea-6698d6b6d249 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:18.341223 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40d62a-a7ab-4212-aeea-6698d6b6d249 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:18.372853 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 97/193] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 17 14:46:18 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:46:18.372853 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40d62a-a7ab-4212-aeea-6698d6b6d249 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:18.424460 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:18.435033 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92801772-8a49-42d5-9b13-213a3faa33c7 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:18.444803 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:18.482955 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d5f7a-bbe1-4f3d-9e75-ab80a6c2577b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:18.483582 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d5f7a-bbe1-4f3d-9e75-ab80a6c2577b None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:18.483863 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d5f7a-bbe1-4f3d-9e75-ab80a6c2577b None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:18.484138 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d5f7a-bbe1-4f3d-9e75-ab80a6c2577b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:18.520776 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40d62a-a7ab-4212-aeea-6698d6b6d249 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:18.571483 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b9178-6e89-4b7b-a8fa-fd690821b71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:18.572090 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b9178-6e89-4b7b-a8fa-fd690821b71d None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:18.572377 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b9178-6e89-4b7b-a8fa-fd690821b71d None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:18.572651 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b9178-6e89-4b7b-a8fa-fd690821b71d None admin] PATH_INFO: `/v3/users/d47c0b5f096e4cb399d5f8047cde151c` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:18.574559 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b9178-6e89-4b7b-a8fa-fd690821b71d None admin] RBAC: Authorizing `identity:get_user(user_id=d47c0b5f096e4cb399d5f8047cde151c)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:18.576312 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b9178-6e89-4b7b-a8fa-fd690821b71d None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:18.577649 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 98/194] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:18 2022] GET /identity/v3/users/d47c0b5f096e4cb399d5f8047cde151c => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:18.583875 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b9178-6e89-4b7b-a8fa-fd690821b71d None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:18.597828 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d5f7a-bbe1-4f3d-9e75-ab80a6c2577b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:18.599318 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d5f7a-bbe1-4f3d-9e75-ab80a6c2577b None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:18.711941 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b9178-6e89-4b7b-a8fa-fd690821b71d None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:18.714720 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:18.720998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 97/195] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:18.727077 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d5f7a-bbe1-4f3d-9e75-ab80a6c2577b None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:18.739204 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:18.757230 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1529b-7ee0-4401-800b-a3fe486f995b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:18.757863 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1529b-7ee0-4401-800b-a3fe486f995b None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:18.758144 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1529b-7ee0-4401-800b-a3fe486f995b None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:18.758412 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1529b-7ee0-4401-800b-a3fe486f995b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:18.849889 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1529b-7ee0-4401-800b-a3fe486f995b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:18.851731 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1529b-7ee0-4401-800b-a3fe486f995b None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:18.855214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d5f7a-bbe1-4f3d-9e75-ab80a6c2577b None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:18.899811 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d0ebe-d11a-4a02-b2a1-78067cc3d2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:18.900455 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d0ebe-d11a-4a02-b2a1-78067cc3d2b7 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:18.900780 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d0ebe-d11a-4a02-b2a1-78067cc3d2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:18.901065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d0ebe-d11a-4a02-b2a1-78067cc3d2b7 None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:18.902344 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d0ebe-d11a-4a02-b2a1-78067cc3d2b7 None admin] RBAC: Authorizing `identity:get_project(project_id=721977c9f4e7432d96ddc227894864f0)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:18.904042 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d0ebe-d11a-4a02-b2a1-78067cc3d2b7 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:18.907009 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 98/196] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:18 2022] GET /identity/v3/projects/721977c9f4e7432d96ddc227894864f0 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:18.916058 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d0ebe-d11a-4a02-b2a1-78067cc3d2b7 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:18.991809 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 99/197] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 14:46:18.998595 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1529b-7ee0-4401-800b-a3fe486f995b None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:19.000593 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:19.052206 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:19.115453 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d0ebe-d11a-4a02-b2a1-78067cc3d2b7 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:19.125294 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1529b-7ee0-4401-800b-a3fe486f995b None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:19.165261 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518ca01-8861-4832-99b5-afe791769a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:19.165895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518ca01-8861-4832-99b5-afe791769a74 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:19.166170 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518ca01-8861-4832-99b5-afe791769a74 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:19.166437 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518ca01-8861-4832-99b5-afe791769a74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:19.167160 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518ca01-8861-4832-99b5-afe791769a74 None admin] RBAC: Adding query filter params (role.id=a307f157f2a445c7af8bd4fd41aa1c4b, scope.project.id=721977c9f4e7432d96ddc227894864f0, user.id=d47c0b5f096e4cb399d5f8047cde151c) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:19.167459 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518ca01-8861-4832-99b5-afe791769a74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:19.168899 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518ca01-8861-4832-99b5-afe791769a74 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:19.170998 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aea6cd-ecbb-476e-bb6e-935b34133a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:19.171642 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aea6cd-ecbb-476e-bb6e-935b34133a6d None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:19.171920 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aea6cd-ecbb-476e-bb6e-935b34133a6d None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:19.172193 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aea6cd-ecbb-476e-bb6e-935b34133a6d None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:19.173947 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aea6cd-ecbb-476e-bb6e-935b34133a6d None admin] RBAC: Authorizing `identity:get_project(project_id=721977c9f4e7432d96ddc227894864f0)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:19.175407 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aea6cd-ecbb-476e-bb6e-935b34133a6d None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:19.177059 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 100/198] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:18 2022] GET /identity/v3/projects/721977c9f4e7432d96ddc227894864f0 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:19.178392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2af34-5272-4bda-a1b8-450ea984d3c1 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:19.178730 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2af34-5272-4bda-a1b8-450ea984d3c1 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:19.179002 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2af34-5272-4bda-a1b8-450ea984d3c1 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:19.180177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 101/199] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:19.184639 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 99/200] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:46:18 2022] GET /identity/v3/role_assignments?user.id=d47c0b5f096e4cb399d5f8047cde151c&scope.project.id=721977c9f4e7432d96ddc227894864f0&role.id=a307f157f2a445c7af8bd4fd41aa1c4b => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:19.185013 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2af34-5272-4bda-a1b8-450ea984d3c1 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:19.187160 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6841f-883b-420a-b291-d0272f45c055 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:19.187443 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6841f-883b-420a-b291-d0272f45c055 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:19.187711 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6841f-883b-420a-b291-d0272f45c055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:19.222977 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-dcb6841f-883b-420a-b291-d0272f45c055 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:19.224189 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-dcb6841f-883b-420a-b291-d0272f45c055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:19.305028 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:19.343410 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2af34-5272-4bda-a1b8-450ea984d3c1 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:19.382998 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec0e5e-6154-44c7-9a85-2e62a0f9129a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:19.383535 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec0e5e-6154-44c7-9a85-2e62a0f9129a None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:19.383813 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec0e5e-6154-44c7-9a85-2e62a0f9129a None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:19.384088 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec0e5e-6154-44c7-9a85-2e62a0f9129a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:19.384845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec0e5e-6154-44c7-9a85-2e62a0f9129a None admin] RBAC: Adding query filter params (role.id=df9fac15c20d418187fbaf38acafd61f, scope.project.id=721977c9f4e7432d96ddc227894864f0, user.id=d47c0b5f096e4cb399d5f8047cde151c) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:19.385151 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec0e5e-6154-44c7-9a85-2e62a0f9129a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:19.386659 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec0e5e-6154-44c7-9a85-2e62a0f9129a None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:19.388104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 100/201] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:19.393758 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 102/202] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:46:19 2022] GET /identity/v3/role_assignments?user.id=d47c0b5f096e4cb399d5f8047cde151c&scope.project.id=721977c9f4e7432d96ddc227894864f0&role.id=df9fac15c20d418187fbaf38acafd61f => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:19.732359 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6841f-883b-420a-b291-d0272f45c055 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:19.830962 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:19.884747 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6841f-883b-420a-b291-d0272f45c055 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:19.931817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8dab6-51b7-4b3d-a612-351070b02fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:19.932810 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8dab6-51b7-4b3d-a612-351070b02fee None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:19.933378 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8dab6-51b7-4b3d-a612-351070b02fee None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:19.933883 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8dab6-51b7-4b3d-a612-351070b02fee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:19.953225 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8dab6-51b7-4b3d-a612-351070b02fee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:19.958312 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-97e8dab6-51b7-4b3d-a612-351070b02fee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:46:19.958312 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:19.958312 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:19.958312 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:19.958312 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:19.958312 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:19.958312 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:19.958312 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:19.958312 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:19.958312 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:19.958312 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:19.958312 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:19.958312 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:19.958312 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:19.958312 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:19.958312 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:19.959199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:19.959199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:19.959199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:19.959199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:19.959199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:19.959199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:19.959199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:19.959199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:19.959199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:19.959199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:19.959199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:19.959199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:19.959199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:19.959199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:19.959199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:19.959199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:19.959992 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:19.959992 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:19.959992 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:19.959992 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:19.959992 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:19.959992 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:19.959992 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:19.959992 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:19.959992 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:19.959992 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:19.959992 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:46:19.959992 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:19.962270 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 101/203] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:19.968817 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec0e5e-6154-44c7-9a85-2e62a0f9129a None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:20.109120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec0e5e-6154-44c7-9a85-2e62a0f9129a None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:20.153412 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d00eb-2ccf-4dac-ba45-d19477a89bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:20.154360 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d00eb-2ccf-4dac-ba45-d19477a89bc1 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:20.154360 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d00eb-2ccf-4dac-ba45-d19477a89bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:20.154609 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d00eb-2ccf-4dac-ba45-d19477a89bc1 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:20.155256 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d00eb-2ccf-4dac-ba45-d19477a89bc1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:20.155558 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d00eb-2ccf-4dac-ba45-d19477a89bc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:20.156925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d00eb-2ccf-4dac-ba45-d19477a89bc1 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:20.158451 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:20.177191 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 103/204] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:20.182786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8dab6-51b7-4b3d-a612-351070b02fee None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:20.343565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8dab6-51b7-4b3d-a612-351070b02fee None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:20.384239 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:20.397838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a004c4-5ce7-4769-8a3e-41e37be30557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:20.398516 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a004c4-5ce7-4769-8a3e-41e37be30557 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:20.398733 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a004c4-5ce7-4769-8a3e-41e37be30557 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:20.399001 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a004c4-5ce7-4769-8a3e-41e37be30557 None admin] PATH_INFO: `/v3/users/21728de833c341a69d04b96062f285d3` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:20.400126 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a004c4-5ce7-4769-8a3e-41e37be30557 None admin] RBAC: Authorizing `identity:get_user(user_id=21728de833c341a69d04b96062f285d3)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:20.401568 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a004c4-5ce7-4769-8a3e-41e37be30557 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:20.403218 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 102/205] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:20 2022] GET /identity/v3/users/21728de833c341a69d04b96062f285d3 => generated 289 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:20.408957 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d00eb-2ccf-4dac-ba45-d19477a89bc1 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:20.547091 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d00eb-2ccf-4dac-ba45-d19477a89bc1 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:20.588861 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80394243-dd78-45f3-99ef-4fbfd8fe4667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:20.589477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80394243-dd78-45f3-99ef-4fbfd8fe4667 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:20.589776 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80394243-dd78-45f3-99ef-4fbfd8fe4667 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:20.590053 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80394243-dd78-45f3-99ef-4fbfd8fe4667 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:20.671489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:20.679151 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80394243-dd78-45f3-99ef-4fbfd8fe4667 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:20.680676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80394243-dd78-45f3-99ef-4fbfd8fe4667 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:20.789292 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 104/206] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:20.796439 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a004c4-5ce7-4769-8a3e-41e37be30557 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:20.948730 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a004c4-5ce7-4769-8a3e-41e37be30557 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:20.997593 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07a5a4-7fe1-4137-8621-df82ff35ae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:20.998604 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07a5a4-7fe1-4137-8621-df82ff35ae08 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:20.999085 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07a5a4-7fe1-4137-8621-df82ff35ae08 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:20.999556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07a5a4-7fe1-4137-8621-df82ff35ae08 None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:21.006403 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07a5a4-7fe1-4137-8621-df82ff35ae08 None admin] RBAC: Authorizing `identity:get_project(project_id=a7643b24b47f42eab63dd25e22c5cdb2)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:21.008066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07a5a4-7fe1-4137-8621-df82ff35ae08 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:21.010284 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 103/207] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:20 2022] GET /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:21.016058 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80394243-dd78-45f3-99ef-4fbfd8fe4667 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:21.172653 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:21.178973 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80394243-dd78-45f3-99ef-4fbfd8fe4667 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:21.226416 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aaf407-bfc2-477b-940d-ff1a4e765ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:21.227023 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aaf407-bfc2-477b-940d-ff1a4e765ce4 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:21.227300 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aaf407-bfc2-477b-940d-ff1a4e765ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:21.227567 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aaf407-bfc2-477b-940d-ff1a4e765ce4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:21.228298 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aaf407-bfc2-477b-940d-ff1a4e765ce4 None admin] RBAC: Adding query filter params (role.id=c04b09acf4454802a88c34604ecd7e5a, scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2, user.id=21728de833c341a69d04b96062f285d3) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:21.228599 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aaf407-bfc2-477b-940d-ff1a4e765ce4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:21.230051 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aaf407-bfc2-477b-940d-ff1a4e765ce4 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:21.240701 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 105/208] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:46:21 2022] GET /identity/v3/role_assignments?user.id=21728de833c341a69d04b96062f285d3&scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2&role.id=c04b09acf4454802a88c34604ecd7e5a => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:21.263500 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3957c-36d7-4e10-89a4-4b79bf6d0d25 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:21.264155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3957c-36d7-4e10-89a4-4b79bf6d0d25 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:21.264637 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3957c-36d7-4e10-89a4-4b79bf6d0d25 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:21.266333 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 104/209] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:21.272242 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce2a0e-c4a3-4512-ab26-695889fc30bc None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:21.272893 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce2a0e-c4a3-4512-ab26-695889fc30bc None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:21.273405 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce2a0e-c4a3-4512-ab26-695889fc30bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:21.294338 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-94ce2a0e-c4a3-4512-ab26-695889fc30bc None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:21.296117 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-94ce2a0e-c4a3-4512-ab26-695889fc30bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:21.374964 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 106/210] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:21.510368 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fe3df-00ad-442e-b70b-fd6a900beb4c None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:21.511320 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fe3df-00ad-442e-b70b-fd6a900beb4c None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:21.511799 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fe3df-00ad-442e-b70b-fd6a900beb4c None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:21.513976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 105/211] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:21.519772 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b12459-4f4f-4415-ad45-a47025b18104 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:21.520346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b12459-4f4f-4415-ad45-a47025b18104 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:21.520821 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b12459-4f4f-4415-ad45-a47025b18104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:21.540107 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-b9b12459-4f4f-4415-ad45-a47025b18104 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:21.541643 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-b9b12459-4f4f-4415-ad45-a47025b18104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:21.647434 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 107/212] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:21.823911 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fe3df-00ad-442e-b70b-fd6a900beb4c None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:21.899814 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:21.946732 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fe3df-00ad-442e-b70b-fd6a900beb4c None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:21.986267 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68c8a7-7716-46f5-a9d5-ababc42f3fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:21.986887 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68c8a7-7716-46f5-a9d5-ababc42f3fdc None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:21.987162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68c8a7-7716-46f5-a9d5-ababc42f3fdc None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:21.987429 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68c8a7-7716-46f5-a9d5-ababc42f3fdc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:22.000995 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68c8a7-7716-46f5-a9d5-ababc42f3fdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:22.005760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-8c68c8a7-7716-46f5-a9d5-ababc42f3fdc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:22.005760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:22.005760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:22.005760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:22.005760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:22.005760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:22.005760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:22.005760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:22.005760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:22.005760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:22.005760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:22.005760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:22.005760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:22.005760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:22.005760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:22.005760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:22.006657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:22.006657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:22.006657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:22.006657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:22.006657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:22.006657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:22.006657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:22.006657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:22.006657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:22.006657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:22.006657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:22.006657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:22.006657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:22.006657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:22.006657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:22.006657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:22.008043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:22.008043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:22.008043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:22.008043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:22.008043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:22.008043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:22.008043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:22.008043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:22.008043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:22.008043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:22.008043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:22.008043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:22.008043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 106/213] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:22.011807 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b12459-4f4f-4415-ad45-a47025b18104 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:22.013083 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68c8a7-7716-46f5-a9d5-ababc42f3fdc None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:22.043414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:22.134789 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b12459-4f4f-4415-ad45-a47025b18104 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:22.138849 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68c8a7-7716-46f5-a9d5-ababc42f3fdc None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:22.166961 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:22.174170 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa87dce-e467-4f39-9cba-051c90a12a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:22.174802 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa87dce-e467-4f39-9cba-051c90a12a31 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:22.175095 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa87dce-e467-4f39-9cba-051c90a12a31 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:22.175359 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa87dce-e467-4f39-9cba-051c90a12a31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:22.176485 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa87dce-e467-4f39-9cba-051c90a12a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:22.177961 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa87dce-e467-4f39-9cba-051c90a12a31 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:22.179695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 108/214] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:46:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:22.180634 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6556c9f-ae2f-47b6-9457-312f1d1683d3 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:22.180916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6556c9f-ae2f-47b6-9457-312f1d1683d3 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:22.181188 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6556c9f-ae2f-47b6-9457-312f1d1683d3 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:22.182396 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 109/215] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:22.182591 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495c076-f884-4984-bf16-c769d541f9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:22.183202 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495c076-f884-4984-bf16-c769d541f9c0 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:22.183547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495c076-f884-4984-bf16-c769d541f9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:22.184016 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495c076-f884-4984-bf16-c769d541f9c0 None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:22.184906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6556c9f-ae2f-47b6-9457-312f1d1683d3 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:22.186455 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495c076-f884-4984-bf16-c769d541f9c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:22.186875 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495c076-f884-4984-bf16-c769d541f9c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:22.188374 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495c076-f884-4984-bf16-c769d541f9c0 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:22.199622 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 107/216] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:22.206135 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a020b00-3568-443c-aff9-314825909007 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:22.206418 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a020b00-3568-443c-aff9-314825909007 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:22.206690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a020b00-3568-443c-aff9-314825909007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:22.224918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-2a020b00-3568-443c-aff9-314825909007 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:22.226131 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-2a020b00-3568-443c-aff9-314825909007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:22.276367 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:22.290036 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6556c9f-ae2f-47b6-9457-312f1d1683d3 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:22.292699 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 108/217] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:22.305880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a020b00-3568-443c-aff9-314825909007 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:22.327003 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c8de3-739d-4db6-9ed0-9953764e15df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:22.328042 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c8de3-739d-4db6-9ed0-9953764e15df None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:22.328327 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c8de3-739d-4db6-9ed0-9953764e15df None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:22.328779 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c8de3-739d-4db6-9ed0-9953764e15df None admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:22.329414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c8de3-739d-4db6-9ed0-9953764e15df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:22.330897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c8de3-739d-4db6-9ed0-9953764e15df None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:22.354021 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 110/218] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 17 14:46:22 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:46:22.355253 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd04537-8933-443a-aa1d-949d045c35ff None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:22.355538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd04537-8933-443a-aa1d-949d045c35ff None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:22.355810 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd04537-8933-443a-aa1d-949d045c35ff None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:22.361397 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 111/219] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:22.363149 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fba36b-2eb3-4e32-828e-8c89ae1d810a None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:22.363439 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fba36b-2eb3-4e32-828e-8c89ae1d810a None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:22.363745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fba36b-2eb3-4e32-828e-8c89ae1d810a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:22.386561 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-57fba36b-2eb3-4e32-828e-8c89ae1d810a None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:22.388740 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-57fba36b-2eb3-4e32-828e-8c89ae1d810a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:22.432790 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a020b00-3568-443c-aff9-314825909007 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:22.454916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:22.485992 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cd014-af0a-4a33-b248-a376277f2a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:22.486989 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cd014-af0a-4a33-b248-a376277f2a19 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:22.488549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cd014-af0a-4a33-b248-a376277f2a19 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:22.489017 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cd014-af0a-4a33-b248-a376277f2a19 None admin] PATH_INFO: `/v3/users/ecd69bba098e4a53b4c4d08a2b85f155` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:22.509760 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 112/220] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:22.510980 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cd014-af0a-4a33-b248-a376277f2a19 None admin] RBAC: Authorizing `identity:get_user(user_id=ecd69bba098e4a53b4c4d08a2b85f155)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:22.512325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cd014-af0a-4a33-b248-a376277f2a19 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:22.514313 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 109/221] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:22 2022] GET /identity/v3/users/ecd69bba098e4a53b4c4d08a2b85f155 => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:22.520070 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fba36b-2eb3-4e32-828e-8c89ae1d810a None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:22.605110 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:22.631636 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cd014-af0a-4a33-b248-a376277f2a19 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:22.636914 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fba36b-2eb3-4e32-828e-8c89ae1d810a None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:22.673039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b822650-cd89-4801-b4d8-bc0977b19af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:22.673639 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b822650-cd89-4801-b4d8-bc0977b19af6 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:22.673943 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b822650-cd89-4801-b4d8-bc0977b19af6 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:22.674261 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b822650-cd89-4801-b4d8-bc0977b19af6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:22.756975 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b822650-cd89-4801-b4d8-bc0977b19af6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:22.758789 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b822650-cd89-4801-b4d8-bc0977b19af6 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:22.778244 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cd014-af0a-4a33-b248-a376277f2a19 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:22.830344 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af70da6-bf19-41a5-be94-4c5b2bb43798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:22.831049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af70da6-bf19-41a5-be94-4c5b2bb43798 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:22.831328 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af70da6-bf19-41a5-be94-4c5b2bb43798 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:22.831602 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af70da6-bf19-41a5-be94-4c5b2bb43798 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:22.844854 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af70da6-bf19-41a5-be94-4c5b2bb43798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:22.849621 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-6af70da6-bf19-41a5-be94-4c5b2bb43798 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:46:22.849621 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:22.849621 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:22.849621 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:22.849621 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:22.849621 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:22.849621 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:22.849621 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:22.849621 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:22.849621 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:22.849621 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:22.849621 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:22.849621 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:22.849621 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:22.849621 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:22.849621 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:22.850515 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:22.850515 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:22.850515 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:22.850515 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:22.850515 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:22.850515 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:22.850515 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:22.850515 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:22.850515 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:22.850515 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:22.850515 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:22.850515 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:22.850515 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:22.850515 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:22.850515 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:22.850515 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:22.851713 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:22.851713 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:22.851713 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:22.851713 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:22.851713 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:22.851713 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:22.851713 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:22.851713 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:22.851713 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:22.851713 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:22.851713 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:46:22.851713 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:22.851713 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 110/222] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 17 14:46:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:46:22.857791 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:22.858032 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af70da6-bf19-41a5-be94-4c5b2bb43798 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:22.887276 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 113/223] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 14:46:22.887882 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b822650-cd89-4801-b4d8-bc0977b19af6 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:22.906001 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:23.004262 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af70da6-bf19-41a5-be94-4c5b2bb43798 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:23.020973 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b822650-cd89-4801-b4d8-bc0977b19af6 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:23.052135 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d43c20-da84-4351-8779-637ce3cf8cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:23.053305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d43c20-da84-4351-8779-637ce3cf8cb7 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:23.053784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d43c20-da84-4351-8779-637ce3cf8cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:23.054429 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d43c20-da84-4351-8779-637ce3cf8cb7 None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:23.055687 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d43c20-da84-4351-8779-637ce3cf8cb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:23.056408 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d43c20-da84-4351-8779-637ce3cf8cb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:23.058630 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d43c20-da84-4351-8779-637ce3cf8cb7 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:23.063397 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872a6eb-e9c2-4906-822a-b5855a87403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:23.064114 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a6eb-e9c2-4906-822a-b5855a87403b None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:23.064463 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a6eb-e9c2-4906-822a-b5855a87403b None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:23.064803 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a6eb-e9c2-4906-822a-b5855a87403b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:23.069646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 111/224] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:23.070761 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d43c20-da84-4351-8779-637ce3cf8cb7 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:23.082135 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872a6eb-e9c2-4906-822a-b5855a87403b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:23.088498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-9872a6eb-e9c2-4906-822a-b5855a87403b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:23.088498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:23.088498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:23.088498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:23.088498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:23.088498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:23.088498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:23.088498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:23.088498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:23.088498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:23.088498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:23.088498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:23.088498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:23.088498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:23.088498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:23.088498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:23.089372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:23.089372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:23.089372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:23.089372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:23.089372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:23.089372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:23.089372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:23.089372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:23.089372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:23.089372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:23.089372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:23.089372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:23.089372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:23.089372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:23.089372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:23.089372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:23.090194 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:23.090194 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:23.090194 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:23.090194 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:23.090194 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:23.090194 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:23.090194 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:23.090194 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:23.090194 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:23.090194 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:23.090194 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:23.090194 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:46:23.092897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 114/225] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:46:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:23.094616 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872a6eb-e9c2-4906-822a-b5855a87403b None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:23.141951 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:23.198068 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:23.206219 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d43c20-da84-4351-8779-637ce3cf8cb7 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:23.224042 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872a6eb-e9c2-4906-822a-b5855a87403b None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:23.247270 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0f8f6-3c6a-4e83-979a-982d5f38ee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:23.248486 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0f8f6-3c6a-4e83-979a-982d5f38ee23 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:23.248904 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0f8f6-3c6a-4e83-979a-982d5f38ee23 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:23.249312 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0f8f6-3c6a-4e83-979a-982d5f38ee23 None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:23.250636 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0f8f6-3c6a-4e83-979a-982d5f38ee23 None admin] RBAC: Authorizing `identity:get_project(project_id=721977c9f4e7432d96ddc227894864f0)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:23.252469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0f8f6-3c6a-4e83-979a-982d5f38ee23 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:23.254784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 112/226] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:23 2022] GET /identity/v3/projects/721977c9f4e7432d96ddc227894864f0 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:23.255810 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0f8f6-3c6a-4e83-979a-982d5f38ee23 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:23.264827 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945432a-962b-4d4f-8ae0-db00876cbcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:23.265609 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945432a-962b-4d4f-8ae0-db00876cbcce None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:23.266013 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945432a-962b-4d4f-8ae0-db00876cbcce None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:23.266382 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945432a-962b-4d4f-8ae0-db00876cbcce None admin] PATH_INFO: `/v3/users/d47c0b5f096e4cb399d5f8047cde151c` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:23.268072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945432a-962b-4d4f-8ae0-db00876cbcce None admin] RBAC: Authorizing `identity:get_user(user_id=d47c0b5f096e4cb399d5f8047cde151c)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:23.270030 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945432a-962b-4d4f-8ae0-db00876cbcce None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:23.272415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 115/227] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:23 2022] GET /identity/v3/users/d47c0b5f096e4cb399d5f8047cde151c => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:23.273260 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945432a-962b-4d4f-8ae0-db00876cbcce None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:23.369324 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0f8f6-3c6a-4e83-979a-982d5f38ee23 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:23.406700 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7cec4-40fc-43e7-8c2d-a4167242be19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:23.407653 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7cec4-40fc-43e7-8c2d-a4167242be19 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:23.407977 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945432a-962b-4d4f-8ae0-db00876cbcce None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:23.408305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7cec4-40fc-43e7-8c2d-a4167242be19 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:23.408740 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7cec4-40fc-43e7-8c2d-a4167242be19 None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:23.409572 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7cec4-40fc-43e7-8c2d-a4167242be19 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:23.409919 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:23.410245 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7cec4-40fc-43e7-8c2d-a4167242be19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:23.411912 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7cec4-40fc-43e7-8c2d-a4167242be19 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:23.422166 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 113/228] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:46:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:23.423052 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7cec4-40fc-43e7-8c2d-a4167242be19 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:23.458171 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:23.460129 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edc370-bc82-4360-bff4-bd0b7e78ffaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:23.460902 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edc370-bc82-4360-bff4-bd0b7e78ffaf None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:23.461140 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edc370-bc82-4360-bff4-bd0b7e78ffaf None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:23.461586 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edc370-bc82-4360-bff4-bd0b7e78ffaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:23.462433 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edc370-bc82-4360-bff4-bd0b7e78ffaf None admin] RBAC: Adding query filter params (role.id=ab06ca80774d48a191fece38e3f335ad, scope.project.id=721977c9f4e7432d96ddc227894864f0, user.id=ecd69bba098e4a53b4c4d08a2b85f155) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:23.463013 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edc370-bc82-4360-bff4-bd0b7e78ffaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:23.464596 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edc370-bc82-4360-bff4-bd0b7e78ffaf None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:23.472020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 116/229] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:46:23 2022] GET /identity/v3/role_assignments?user.id=ecd69bba098e4a53b4c4d08a2b85f155&scope.project.id=721977c9f4e7432d96ddc227894864f0&role.id=ab06ca80774d48a191fece38e3f335ad => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:23.472861 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edc370-bc82-4360-bff4-bd0b7e78ffaf None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:23.578541 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7cec4-40fc-43e7-8c2d-a4167242be19 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:23.607653 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edc370-bc82-4360-bff4-bd0b7e78ffaf None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:23.650526 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308d362-5191-43f5-9d11-d882c874c689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:23.651167 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d362-5191-43f5-9d11-d882c874c689 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:23.651474 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d362-5191-43f5-9d11-d882c874c689 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:23.651719 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d362-5191-43f5-9d11-d882c874c689 None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:23.653047 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308d362-5191-43f5-9d11-d882c874c689 None admin] RBAC: Authorizing `identity:get_project(project_id=721977c9f4e7432d96ddc227894864f0)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:23.655069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308d362-5191-43f5-9d11-d882c874c689 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:23.656168 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6932661-a6cd-4520-a589-67e0dc8b07bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:23.656817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 114/230] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:23 2022] GET /identity/v3/projects/721977c9f4e7432d96ddc227894864f0 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:23.657312 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6932661-a6cd-4520-a589-67e0dc8b07bb None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:23.661996 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6932661-a6cd-4520-a589-67e0dc8b07bb None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:23.662596 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6932661-a6cd-4520-a589-67e0dc8b07bb None admin] PATH_INFO: `/v3/users/d47c0b5f096e4cb399d5f8047cde151c` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:23.664140 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6932661-a6cd-4520-a589-67e0dc8b07bb None admin] RBAC: Authorizing `identity:get_user(user_id=d47c0b5f096e4cb399d5f8047cde151c)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:23.666692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6932661-a6cd-4520-a589-67e0dc8b07bb None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:23.667726 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308d362-5191-43f5-9d11-d882c874c689 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:23.669082 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 117/231] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:23 2022] GET /identity/v3/users/d47c0b5f096e4cb399d5f8047cde151c => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:23.674659 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6932661-a6cd-4520-a589-67e0dc8b07bb None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:23.714459 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:23.788425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6932661-a6cd-4520-a589-67e0dc8b07bb None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:23.824648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d039229-68e2-4eff-afa8-7f5649a9a446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:23.825703 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d039229-68e2-4eff-afa8-7f5649a9a446 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:23.826213 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d039229-68e2-4eff-afa8-7f5649a9a446 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:23.826751 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d039229-68e2-4eff-afa8-7f5649a9a446 None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:23.828118 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d039229-68e2-4eff-afa8-7f5649a9a446 None admin] RBAC: Authorizing `identity:get_project(project_id=721977c9f4e7432d96ddc227894864f0)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:23.829779 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d039229-68e2-4eff-afa8-7f5649a9a446 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:23.831829 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 118/232] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:23 2022] GET /identity/v3/projects/721977c9f4e7432d96ddc227894864f0 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:23.838610 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d039229-68e2-4eff-afa8-7f5649a9a446 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:23.932343 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:23.979591 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d039229-68e2-4eff-afa8-7f5649a9a446 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:23.981825 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308d362-5191-43f5-9d11-d882c874c689 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:23.998147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:24.017407 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db102a90-ec1c-4cb4-b761-c6bcb48ce60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:24.018632 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db102a90-ec1c-4cb4-b761-c6bcb48ce60d None admin] REQUEST_METHOD: `PUT` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:24.019112 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db102a90-ec1c-4cb4-b761-c6bcb48ce60d None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:24.019580 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db102a90-ec1c-4cb4-b761-c6bcb48ce60d None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0/users/d47c0b5f096e4cb399d5f8047cde151c/roles/df9fac15c20d418187fbaf38acafd61f` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:24.022074 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db102a90-ec1c-4cb4-b761-c6bcb48ce60d None admin] RBAC: Authorizing `identity:create_grant(project_id=721977c9f4e7432d96ddc227894864f0, user_id=d47c0b5f096e4cb399d5f8047cde151c, role_id=df9fac15c20d418187fbaf38acafd61f)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:24.023751 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db102a90-ec1c-4cb4-b761-c6bcb48ce60d None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:24.045581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 119/233] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 17 14:46:23 2022] PUT /identity/v3/projects/721977c9f4e7432d96ddc227894864f0/users/d47c0b5f096e4cb399d5f8047cde151c/roles/df9fac15c20d418187fbaf38acafd61f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:46:24.088002 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc3c24-e710-4474-aa07-91826b328ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:24.088690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc3c24-e710-4474-aa07-91826b328ba0 None admin] REQUEST_METHOD: `PUT` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:24.088976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc3c24-e710-4474-aa07-91826b328ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:24.089251 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc3c24-e710-4474-aa07-91826b328ba0 None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0/users/d47c0b5f096e4cb399d5f8047cde151c/roles/a307f157f2a445c7af8bd4fd41aa1c4b` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:24.095292 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc3c24-e710-4474-aa07-91826b328ba0 None admin] RBAC: Authorizing `identity:create_grant(project_id=721977c9f4e7432d96ddc227894864f0, user_id=d47c0b5f096e4cb399d5f8047cde151c, role_id=a307f157f2a445c7af8bd4fd41aa1c4b)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:24.096782 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc3c24-e710-4474-aa07-91826b328ba0 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:24.126287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 115/234] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 17 14:46:23 2022] PUT /identity/v3/projects/721977c9f4e7432d96ddc227894864f0/users/d47c0b5f096e4cb399d5f8047cde151c/roles/a307f157f2a445c7af8bd4fd41aa1c4b => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:46:25.249238 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70024362-7f5f-4923-9240-9f4bb61ff8a4 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:25.250297 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70024362-7f5f-4923-9240-9f4bb61ff8a4 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:25.250799 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70024362-7f5f-4923-9240-9f4bb61ff8a4 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:25.252621 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 120/235] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:25.257782 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6decc-ef2c-4f45-ad33-e07bddf12894 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:25.258597 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6decc-ef2c-4f45-ad33-e07bddf12894 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:25.259071 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6decc-ef2c-4f45-ad33-e07bddf12894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:25.282555 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-a0b6decc-ef2c-4f45-ad33-e07bddf12894 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:25.284023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-a0b6decc-ef2c-4f45-ad33-e07bddf12894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:25.363268 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 116/236] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:46:25.535043 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e0eef-1920-4bf2-b891-f93aa6ebfbe2 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:25.535685 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e0eef-1920-4bf2-b891-f93aa6ebfbe2 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:25.535976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e0eef-1920-4bf2-b891-f93aa6ebfbe2 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:25.537505 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 121/237] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:25.542790 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf37207-10a0-4b64-a7ed-66634e7b208c None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:25.543688 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf37207-10a0-4b64-a7ed-66634e7b208c None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:25.544190 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf37207-10a0-4b64-a7ed-66634e7b208c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:25.568970 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-5bf37207-10a0-4b64-a7ed-66634e7b208c None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:25.570185 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-5bf37207-10a0-4b64-a7ed-66634e7b208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:25.664320 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 117/238] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:25.908123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e0eef-1920-4bf2-b891-f93aa6ebfbe2 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:25.960817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf7aa3-021f-4601-a627-5a7da7273c21 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:25.961172 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf7aa3-021f-4601-a627-5a7da7273c21 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:25.961364 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf7aa3-021f-4601-a627-5a7da7273c21 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:25.962732 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 118/239] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:46:25.968861 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2feba-306f-4e46-9c57-8ad7f94a06d0 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:25.969139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2feba-306f-4e46-9c57-8ad7f94a06d0 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:25.969410 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2feba-306f-4e46-9c57-8ad7f94a06d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:26.004975 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-91d2feba-306f-4e46-9c57-8ad7f94a06d0 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:26.008729 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-91d2feba-306f-4e46-9c57-8ad7f94a06d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:26.028965 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:26.069004 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e0eef-1920-4bf2-b891-f93aa6ebfbe2 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:26.135795 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2bc62-f790-40d7-b95e-d0d46b7c4bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:26.136437 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2bc62-f790-40d7-b95e-d0d46b7c4bdc None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:26.136717 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2bc62-f790-40d7-b95e-d0d46b7c4bdc None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:26.136985 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2bc62-f790-40d7-b95e-d0d46b7c4bdc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:26.148676 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 119/240] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:26.149687 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2feba-306f-4e46-9c57-8ad7f94a06d0 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:26.152319 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2bc62-f790-40d7-b95e-d0d46b7c4bdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:26.157775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-3cd2bc62-f790-40d7-b95e-d0d46b7c4bdc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:46:26.157775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:26.157775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:26.157775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:26.157775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:26.157775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:26.157775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:26.157775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:26.157775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:26.157775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:26.157775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:26.157775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:26.157775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:26.157775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:26.157775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:26.157775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:26.158716 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:26.158716 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:26.158716 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:26.158716 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:26.158716 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:26.158716 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:26.158716 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:26.158716 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:26.158716 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:26.158716 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:26.158716 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:26.158716 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:26.158716 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:26.158716 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:26.158716 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:26.158716 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:26.159915 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:26.159915 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:26.159915 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:26.159915 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:26.159915 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:26.159915 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:26.159915 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:26.159915 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:26.159915 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:26.159915 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:26.159915 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:46:26.159915 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:46:26.159915 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 122/241] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:26.174780 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2bc62-f790-40d7-b95e-d0d46b7c4bdc None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:26.224824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:26.259941 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2feba-306f-4e46-9c57-8ad7f94a06d0 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:26.300277 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ad0d8-cfa2-4549-bb2d-434b55ad8a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:26.300915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ad0d8-cfa2-4549-bb2d-434b55ad8a5a None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:26.301197 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ad0d8-cfa2-4549-bb2d-434b55ad8a5a None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:26.301635 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ad0d8-cfa2-4549-bb2d-434b55ad8a5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:26.303456 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ad0d8-cfa2-4549-bb2d-434b55ad8a5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:26.304901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ad0d8-cfa2-4549-bb2d-434b55ad8a5a None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:26.308101 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 120/242] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:46:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:26.313935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ad0d8-cfa2-4549-bb2d-434b55ad8a5a None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:26.342131 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:26.393747 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2bc62-f790-40d7-b95e-d0d46b7c4bdc None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:26.457200 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0254f35-ca1f-4111-aa53-6111499daed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:26.457847 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0254f35-ca1f-4111-aa53-6111499daed4 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:26.458128 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0254f35-ca1f-4111-aa53-6111499daed4 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:26.458398 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0254f35-ca1f-4111-aa53-6111499daed4 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:26.459078 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0254f35-ca1f-4111-aa53-6111499daed4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:26.459379 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0254f35-ca1f-4111-aa53-6111499daed4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:26.460762 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0254f35-ca1f-4111-aa53-6111499daed4 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:26.480202 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 123/243] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:26.501616 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0254f35-ca1f-4111-aa53-6111499daed4 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:26.502616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ad0d8-cfa2-4549-bb2d-434b55ad8a5a None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:26.546289 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee9a99-7f6f-4496-a0f2-5418b0955b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:26.547009 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee9a99-7f6f-4496-a0f2-5418b0955b2f None admin] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:26.547287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee9a99-7f6f-4496-a0f2-5418b0955b2f None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:26.547557 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee9a99-7f6f-4496-a0f2-5418b0955b2f None admin] PATH_INFO: `/v3/users` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:26.549973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee9a99-7f6f-4496-a0f2-5418b0955b2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:26.549973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee9a99-7f6f-4496-a0f2-5418b0955b2f None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:26.579918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 121/244] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 17 14:46:26 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:46:26.580761 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee9a99-7f6f-4496-a0f2-5418b0955b2f None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:26.621526 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:26.643069 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0254f35-ca1f-4111-aa53-6111499daed4 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:26.664854 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:26.694060 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a3e52-6bc4-4db9-98d3-c871b6c95a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:26.695525 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a3e52-6bc4-4db9-98d3-c871b6c95a78 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:26.695962 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a3e52-6bc4-4db9-98d3-c871b6c95a78 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:26.696478 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a3e52-6bc4-4db9-98d3-c871b6c95a78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:26.707395 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee9a99-7f6f-4496-a0f2-5418b0955b2f None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:26.709472 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a3e52-6bc4-4db9-98d3-c871b6c95a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:26.715328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-dd5a3e52-6bc4-4db9-98d3-c871b6c95a78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:26.715328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:26.715328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:26.715328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:26.715328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:26.715328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:26.715328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:26.715328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:26.715328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:26.715328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:26.715328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:26.715328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:26.715328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:26.715328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:26.715328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:26.715328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:26.716846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:26.716846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:26.716846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:26.716846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:26.716846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:26.716846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:26.716846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:26.716846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:26.716846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:26.716846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:26.716846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:26.716846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:26.716846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:26.716846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:26.716846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:26.716846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:26.717751 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:26.717751 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:26.717751 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:26.717751 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:26.717751 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:26.717751 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:26.717751 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:26.717751 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:26.717751 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:26.717751 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:26.717751 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:26.717751 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:46:26.720177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 124/245] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:46:26.726432 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a3e52-6bc4-4db9-98d3-c871b6c95a78 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:26.749128 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1352dc1-2832-4321-ad7d-cb26fb9e2bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:26.749916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1352dc1-2832-4321-ad7d-cb26fb9e2bb2 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:26.750321 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1352dc1-2832-4321-ad7d-cb26fb9e2bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:26.750666 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1352dc1-2832-4321-ad7d-cb26fb9e2bb2 None admin] PATH_INFO: `/v3/users/3083ae1c52134f2aa91aa1895a523d70` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:26.766788 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1352dc1-2832-4321-ad7d-cb26fb9e2bb2 None admin] RBAC: Authorizing `identity:get_user(user_id=3083ae1c52134f2aa91aa1895a523d70)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:26.768375 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1352dc1-2832-4321-ad7d-cb26fb9e2bb2 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:26.770567 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 122/246] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:26 2022] GET /identity/v3/users/3083ae1c52134f2aa91aa1895a523d70 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:26.776495 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1352dc1-2832-4321-ad7d-cb26fb9e2bb2 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:26.847883 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a3e52-6bc4-4db9-98d3-c871b6c95a78 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:26.892883 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419a19d-9098-4aef-9f18-cab35d678f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:26.893972 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419a19d-9098-4aef-9f18-cab35d678f54 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:26.894478 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419a19d-9098-4aef-9f18-cab35d678f54 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:26.894950 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419a19d-9098-4aef-9f18-cab35d678f54 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:26.895820 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419a19d-9098-4aef-9f18-cab35d678f54 None admin] RBAC: Adding query filter params (name=member) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:26.896319 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419a19d-9098-4aef-9f18-cab35d678f54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:26.898670 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419a19d-9098-4aef-9f18-cab35d678f54 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:26.915464 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 125/247] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:26.915464 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fa0ed-fda4-4591-8501-f92fde0c7474 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:26.915874 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fa0ed-fda4-4591-8501-f92fde0c7474 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:26.916037 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fa0ed-fda4-4591-8501-f92fde0c7474 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:26.918125 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 126/248] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:26.919031 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fa0ed-fda4-4591-8501-f92fde0c7474 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:26.921839 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1352dc1-2832-4321-ad7d-cb26fb9e2bb2 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:26.935578 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:26.957234 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:26.966668 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b333c-489c-45d0-bb3a-5f57b5c2fcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:26.967514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b333c-489c-45d0-bb3a-5f57b5c2fcd3 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:26.967788 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b333c-489c-45d0-bb3a-5f57b5c2fcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:26.968052 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b333c-489c-45d0-bb3a-5f57b5c2fcd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:27.069489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b333c-489c-45d0-bb3a-5f57b5c2fcd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:27.069489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b333c-489c-45d0-bb3a-5f57b5c2fcd3 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:27.081139 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fa0ed-fda4-4591-8501-f92fde0c7474 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:27.126244 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fe183-7368-4b33-8b63-65ab2224a106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:27.127239 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fe183-7368-4b33-8b63-65ab2224a106 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:27.127723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fe183-7368-4b33-8b63-65ab2224a106 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:27.128200 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fe183-7368-4b33-8b63-65ab2224a106 None admin] PATH_INFO: `/v3/users/ecd69bba098e4a53b4c4d08a2b85f155` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:27.129828 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fe183-7368-4b33-8b63-65ab2224a106 None admin] RBAC: Authorizing `identity:get_user(user_id=ecd69bba098e4a53b4c4d08a2b85f155)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:27.131486 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fe183-7368-4b33-8b63-65ab2224a106 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:27.133303 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 127/249] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:26 2022] GET /identity/v3/users/ecd69bba098e4a53b4c4d08a2b85f155 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:27.135692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d089ced-b20b-4779-9cb6-160795301629 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:27.136185 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d089ced-b20b-4779-9cb6-160795301629 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:27.136674 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d089ced-b20b-4779-9cb6-160795301629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:27.157781 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-1d089ced-b20b-4779-9cb6-160795301629 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:27.159543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-1d089ced-b20b-4779-9cb6-160795301629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:27.209233 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 123/250] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 14:46:27.218933 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b333c-489c-45d0-bb3a-5f57b5c2fcd3 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:27.246212 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 128/251] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:27.248249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a14d-746b-40ad-b863-aa5a0663b015 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:27.248583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a14d-746b-40ad-b863-aa5a0663b015 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:27.248916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a14d-746b-40ad-b863-aa5a0663b015 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:27.250225 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 129/252] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:27.250923 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8a14d-746b-40ad-b863-aa5a0663b015 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:27.256250 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:27.259653 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:27.360134 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8a14d-746b-40ad-b863-aa5a0663b015 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:27.360777 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b333c-489c-45d0-bb3a-5f57b5c2fcd3 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:27.395937 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb99fd-28c4-4686-b6ec-1c7f32daec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:27.396566 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb99fd-28c4-4686-b6ec-1c7f32daec84 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:27.397010 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb99fd-28c4-4686-b6ec-1c7f32daec84 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:27.397357 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb99fd-28c4-4686-b6ec-1c7f32daec84 None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:27.398663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb99fd-28c4-4686-b6ec-1c7f32daec84 None admin] RBAC: Authorizing `identity:get_project(project_id=721977c9f4e7432d96ddc227894864f0)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:27.400306 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb99fd-28c4-4686-b6ec-1c7f32daec84 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:27.402198 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 130/253] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:27 2022] GET /identity/v3/projects/721977c9f4e7432d96ddc227894864f0 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:27.403658 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b70d0-70b0-49d0-be8e-f9601d72f372 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:27.404026 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b70d0-70b0-49d0-be8e-f9601d72f372 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:27.404302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b70d0-70b0-49d0-be8e-f9601d72f372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:27.414258 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9777a3a-0b84-4205-8706-51f63b61eabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:27.414904 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9777a3a-0b84-4205-8706-51f63b61eabe None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:27.415287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9777a3a-0b84-4205-8706-51f63b61eabe None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:27.415562 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9777a3a-0b84-4205-8706-51f63b61eabe None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:27.416715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9777a3a-0b84-4205-8706-51f63b61eabe None admin] RBAC: Authorizing `identity:get_project(project_id=721977c9f4e7432d96ddc227894864f0)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:27.419456 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9777a3a-0b84-4205-8706-51f63b61eabe None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:27.424707 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-b39b70d0-70b0-49d0-be8e-f9601d72f372 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:27.425832 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 124/254] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:27 2022] GET /identity/v3/projects/721977c9f4e7432d96ddc227894864f0 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:27.426009 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-b39b70d0-70b0-49d0-be8e-f9601d72f372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:27.426763 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9777a3a-0b84-4205-8706-51f63b61eabe None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:27.539516 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:27.565590 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9777a3a-0b84-4205-8706-51f63b61eabe None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:27.585422 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 131/255] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:27.586451 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b70d0-70b0-49d0-be8e-f9601d72f372 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:27.593020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:27.626156 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c2648-f5ba-4daa-9ca0-64032317352c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:27.627405 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c2648-f5ba-4daa-9ca0-64032317352c None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:27.627883 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c2648-f5ba-4daa-9ca0-64032317352c None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:27.628348 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c2648-f5ba-4daa-9ca0-64032317352c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:27.629927 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c2648-f5ba-4daa-9ca0-64032317352c None admin] RBAC: Adding query filter params (role.id=c04b09acf4454802a88c34604ecd7e5a, scope.project.id=721977c9f4e7432d96ddc227894864f0, user.id=3083ae1c52134f2aa91aa1895a523d70) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:27.630440 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c2648-f5ba-4daa-9ca0-64032317352c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:27.632401 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c2648-f5ba-4daa-9ca0-64032317352c None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:27.640230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 125/256] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:46:27 2022] GET /identity/v3/role_assignments?user.id=3083ae1c52134f2aa91aa1895a523d70&scope.project.id=721977c9f4e7432d96ddc227894864f0&role.id=c04b09acf4454802a88c34604ecd7e5a => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:27.755348 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b70d0-70b0-49d0-be8e-f9601d72f372 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:27.792201 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13266cd2-837d-470e-8417-ff4271979516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:27.792800 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13266cd2-837d-470e-8417-ff4271979516 None admin] REQUEST_METHOD: `PUT` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:27.793076 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13266cd2-837d-470e-8417-ff4271979516 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:27.793351 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13266cd2-837d-470e-8417-ff4271979516 None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0/users/ecd69bba098e4a53b4c4d08a2b85f155/roles/ab06ca80774d48a191fece38e3f335ad` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:27.795434 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13266cd2-837d-470e-8417-ff4271979516 None admin] RBAC: Authorizing `identity:create_grant(project_id=721977c9f4e7432d96ddc227894864f0, user_id=ecd69bba098e4a53b4c4d08a2b85f155, role_id=ab06ca80774d48a191fece38e3f335ad)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:27.797057 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13266cd2-837d-470e-8417-ff4271979516 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:27.812481 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 132/257] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 17 14:46:27 2022] PUT /identity/v3/projects/721977c9f4e7432d96ddc227894864f0/users/ecd69bba098e4a53b4c4d08a2b85f155/roles/ab06ca80774d48a191fece38e3f335ad => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:46:27.834331 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c2648-f5ba-4daa-9ca0-64032317352c None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:27.997760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c2648-f5ba-4daa-9ca0-64032317352c None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:28.045580 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0193384-2780-45f1-9fc0-c3036a668737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:28.046489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0193384-2780-45f1-9fc0-c3036a668737 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:28.046935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0193384-2780-45f1-9fc0-c3036a668737 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:28.047346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0193384-2780-45f1-9fc0-c3036a668737 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:28.062774 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0193384-2780-45f1-9fc0-c3036a668737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:28.067916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-b0193384-2780-45f1-9fc0-c3036a668737 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:46:28.067916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:28.067916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:28.067916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:28.067916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:28.067916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:28.067916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:28.067916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:28.067916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:28.067916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:28.067916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:28.067916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:28.067916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:28.067916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:28.067916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:28.067916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:28.069065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:28.069065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:28.069065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:28.069065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:28.069065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:28.069065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:28.069065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:28.069065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:28.069065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:28.069065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:28.069065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:28.069065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:28.069065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:28.069065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:28.069065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:28.069065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:28.070047 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:28.070047 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:28.070047 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:28.070047 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:28.070047 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:28.070047 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:28.070047 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:28.070047 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:28.070047 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:28.070047 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:28.070047 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:46:28.070047 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:28.073535 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 126/258] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 17 14:46:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:28.079295 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13266cd2-837d-470e-8417-ff4271979516 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:28.115396 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0193384-2780-45f1-9fc0-c3036a668737 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:28.157635 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:28.182110 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:28.245209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13266cd2-837d-470e-8417-ff4271979516 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:28.316529 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63034837-f80d-4907-a0b7-d811fe0ba959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:28.317074 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63034837-f80d-4907-a0b7-d811fe0ba959 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:28.317355 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63034837-f80d-4907-a0b7-d811fe0ba959 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:28.317624 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63034837-f80d-4907-a0b7-d811fe0ba959 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:28.318329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63034837-f80d-4907-a0b7-d811fe0ba959 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:28.318631 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63034837-f80d-4907-a0b7-d811fe0ba959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:28.320953 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63034837-f80d-4907-a0b7-d811fe0ba959 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:28.325108 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0193384-2780-45f1-9fc0-c3036a668737 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:28.342358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 133/259] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:28.348886 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63034837-f80d-4907-a0b7-d811fe0ba959 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:28.398457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafeeb9e-2ce3-48ac-8c6a-6a5ed1c4ac60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:28.399109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafeeb9e-2ce3-48ac-8c6a-6a5ed1c4ac60 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:28.399366 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafeeb9e-2ce3-48ac-8c6a-6a5ed1c4ac60 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:28.399646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafeeb9e-2ce3-48ac-8c6a-6a5ed1c4ac60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:28.421744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafeeb9e-2ce3-48ac-8c6a-6a5ed1c4ac60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:28.426742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-cafeeb9e-2ce3-48ac-8c6a-6a5ed1c4ac60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:28.426742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:28.426742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:28.426742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:28.426742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:28.426742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:28.426742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:28.426742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:28.426742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:28.426742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:28.426742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:28.426742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:28.426742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:28.426742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:28.426742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:28.426742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:28.427802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:28.427802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:28.427802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:28.427802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:28.427802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:28.427802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:28.427802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:28.427802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:28.427802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:28.427802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:28.427802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:28.427802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:28.427802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:28.427802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:28.427802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:28.427802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:28.429003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:28.429003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:28.429003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:28.429003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:28.429003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:28.429003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:28.429003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:28.429003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:28.429003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:28.429003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:28.429003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:28.429003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:28.429003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 127/260] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:46:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:46:28.434107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafeeb9e-2ce3-48ac-8c6a-6a5ed1c4ac60 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:28.501153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63034837-f80d-4907-a0b7-d811fe0ba959 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:28.519730 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:28.544659 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafeeb9e-2ce3-48ac-8c6a-6a5ed1c4ac60 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:28.564922 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:28.573277 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab969de-952a-4b65-bc08-0ebe4dce268a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:28.573923 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab969de-952a-4b65-bc08-0ebe4dce268a None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:28.574240 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab969de-952a-4b65-bc08-0ebe4dce268a None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:28.574572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab969de-952a-4b65-bc08-0ebe4dce268a None admin] PATH_INFO: `/v3/users/d47c0b5f096e4cb399d5f8047cde151c` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:28.575864 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab969de-952a-4b65-bc08-0ebe4dce268a None admin] RBAC: Authorizing `identity:get_user(user_id=d47c0b5f096e4cb399d5f8047cde151c)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:28.577381 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab969de-952a-4b65-bc08-0ebe4dce268a None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:28.579094 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 134/261] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:28 2022] GET /identity/v3/users/d47c0b5f096e4cb399d5f8047cde151c => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:28.585420 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c5bf4-0851-4870-8ea2-5b0fc37f6d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:28.586102 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c5bf4-0851-4870-8ea2-5b0fc37f6d6f None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:28.586382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c5bf4-0851-4870-8ea2-5b0fc37f6d6f None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:28.586483 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab969de-952a-4b65-bc08-0ebe4dce268a None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:28.586653 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c5bf4-0851-4870-8ea2-5b0fc37f6d6f None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:28.587418 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c5bf4-0851-4870-8ea2-5b0fc37f6d6f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:28.587721 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c5bf4-0851-4870-8ea2-5b0fc37f6d6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:28.589117 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c5bf4-0851-4870-8ea2-5b0fc37f6d6f None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:28.598748 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 128/262] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:46:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:28.604410 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c5bf4-0851-4870-8ea2-5b0fc37f6d6f None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:28.712299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c5bf4-0851-4870-8ea2-5b0fc37f6d6f None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:28.749680 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf6d92-ab83-47ba-9b71-a8a3f473e428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:28.750576 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf6d92-ab83-47ba-9b71-a8a3f473e428 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:28.751004 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf6d92-ab83-47ba-9b71-a8a3f473e428 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:28.751436 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf6d92-ab83-47ba-9b71-a8a3f473e428 None admin] PATH_INFO: `/v3/users/d47c0b5f096e4cb399d5f8047cde151c` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:28.752891 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf6d92-ab83-47ba-9b71-a8a3f473e428 None admin] RBAC: Authorizing `identity:get_user(user_id=d47c0b5f096e4cb399d5f8047cde151c)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:28.755602 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf6d92-ab83-47ba-9b71-a8a3f473e428 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:28.758607 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 129/263] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:28 2022] GET /identity/v3/users/d47c0b5f096e4cb399d5f8047cde151c => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:28.764956 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf6d92-ab83-47ba-9b71-a8a3f473e428 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:28.776925 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:28.794333 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab969de-952a-4b65-bc08-0ebe4dce268a None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:28.872678 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf6d92-ab83-47ba-9b71-a8a3f473e428 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:28.887873 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba90e14-9b81-4b62-b8ab-1f7a2ba0f015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:28.888489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba90e14-9b81-4b62-b8ab-1f7a2ba0f015 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:28.888769 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba90e14-9b81-4b62-b8ab-1f7a2ba0f015 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:28.889040 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba90e14-9b81-4b62-b8ab-1f7a2ba0f015 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:28.908683 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c420b-dea2-4060-a464-bdaa6b16ee17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:28.909575 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c420b-dea2-4060-a464-bdaa6b16ee17 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:28.910127 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c420b-dea2-4060-a464-bdaa6b16ee17 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:28.910641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c420b-dea2-4060-a464-bdaa6b16ee17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:28.982413 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c420b-dea2-4060-a464-bdaa6b16ee17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:28.984241 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c420b-dea2-4060-a464-bdaa6b16ee17 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:29.000456 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:29.046731 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:29.082826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba90e14-9b81-4b62-b8ab-1f7a2ba0f015 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:29.084381 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba90e14-9b81-4b62-b8ab-1f7a2ba0f015 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:29.091651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 130/264] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:29.097347 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c420b-dea2-4060-a464-bdaa6b16ee17 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:29.205520 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c420b-dea2-4060-a464-bdaa6b16ee17 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:29.216630 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:29.243597 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05e281-16bb-46b3-b290-a75b4f6a7913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:29.244583 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05e281-16bb-46b3-b290-a75b4f6a7913 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:29.245072 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05e281-16bb-46b3-b290-a75b4f6a7913 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:29.245534 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05e281-16bb-46b3-b290-a75b4f6a7913 None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:29.247947 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05e281-16bb-46b3-b290-a75b4f6a7913 None admin] RBAC: Authorizing `identity:get_project(project_id=721977c9f4e7432d96ddc227894864f0)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:29.249612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05e281-16bb-46b3-b290-a75b4f6a7913 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:29.251835 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 131/265] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:29 2022] GET /identity/v3/projects/721977c9f4e7432d96ddc227894864f0 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:29.258811 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05e281-16bb-46b3-b290-a75b4f6a7913 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:29.294607 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 135/266] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 14:46:29.300044 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba90e14-9b81-4b62-b8ab-1f7a2ba0f015 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:29.369654 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05e281-16bb-46b3-b290-a75b4f6a7913 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:29.442983 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702aecf2-bb0d-4b79-9313-58eb98748d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:29.443776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702aecf2-bb0d-4b79-9313-58eb98748d28 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:29.443938 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702aecf2-bb0d-4b79-9313-58eb98748d28 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:29.444187 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702aecf2-bb0d-4b79-9313-58eb98748d28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:29.444929 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702aecf2-bb0d-4b79-9313-58eb98748d28 None admin] RBAC: Adding query filter params (role.id=df9fac15c20d418187fbaf38acafd61f, scope.project.id=721977c9f4e7432d96ddc227894864f0, user.id=d47c0b5f096e4cb399d5f8047cde151c) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:29.445228 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702aecf2-bb0d-4b79-9313-58eb98748d28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:29.446682 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702aecf2-bb0d-4b79-9313-58eb98748d28 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:29.457020 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 132/267] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:46:29 2022] GET /identity/v3/role_assignments?user.id=d47c0b5f096e4cb399d5f8047cde151c&scope.project.id=721977c9f4e7432d96ddc227894864f0&role.id=df9fac15c20d418187fbaf38acafd61f => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:29.485080 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:29.492504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba90e14-9b81-4b62-b8ab-1f7a2ba0f015 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:29.545058 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567119a-98e8-4b35-93b7-c6ae64b40c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:29.545882 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567119a-98e8-4b35-93b7-c6ae64b40c54 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:29.546047 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567119a-98e8-4b35-93b7-c6ae64b40c54 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:29.546315 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567119a-98e8-4b35-93b7-c6ae64b40c54 None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:29.547501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567119a-98e8-4b35-93b7-c6ae64b40c54 None admin] RBAC: Authorizing `identity:get_project(project_id=721977c9f4e7432d96ddc227894864f0)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:29.549009 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567119a-98e8-4b35-93b7-c6ae64b40c54 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:29.550686 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 136/268] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:29 2022] GET /identity/v3/projects/721977c9f4e7432d96ddc227894864f0 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:29.566117 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702aecf2-bb0d-4b79-9313-58eb98748d28 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:29.623511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:29.703381 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702aecf2-bb0d-4b79-9313-58eb98748d28 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:29.741318 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b030ed-4f70-41eb-88f7-e62544fd0244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:29.741884 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b030ed-4f70-41eb-88f7-e62544fd0244 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:29.742167 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b030ed-4f70-41eb-88f7-e62544fd0244 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:29.742438 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b030ed-4f70-41eb-88f7-e62544fd0244 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:29.743184 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b030ed-4f70-41eb-88f7-e62544fd0244 None admin] RBAC: Adding query filter params (role.id=a307f157f2a445c7af8bd4fd41aa1c4b, scope.project.id=721977c9f4e7432d96ddc227894864f0, user.id=d47c0b5f096e4cb399d5f8047cde151c) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:29.743492 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b030ed-4f70-41eb-88f7-e62544fd0244 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:29.744948 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b030ed-4f70-41eb-88f7-e62544fd0244 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:29.759361 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 133/269] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:46:29 2022] GET /identity/v3/role_assignments?user.id=d47c0b5f096e4cb399d5f8047cde151c&scope.project.id=721977c9f4e7432d96ddc227894864f0&role.id=a307f157f2a445c7af8bd4fd41aa1c4b => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:30.139513 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d66d1-13d6-4dd6-8b02-fc4b8bf7b3a4 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:30.140160 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d66d1-13d6-4dd6-8b02-fc4b8bf7b3a4 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:30.140654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d66d1-13d6-4dd6-8b02-fc4b8bf7b3a4 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:30.142542 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 137/270] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:30.147646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865b69b-027c-4f0d-b6ef-157c0d6c0b64 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:30.148190 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865b69b-027c-4f0d-b6ef-157c0d6c0b64 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:30.148661 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865b69b-027c-4f0d-b6ef-157c0d6c0b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:30.168951 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-3865b69b-027c-4f0d-b6ef-157c0d6c0b64 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:30.170688 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-3865b69b-027c-4f0d-b6ef-157c0d6c0b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:30.252508 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 134/271] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:30.255164 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c514b0-1f41-40a7-afd6-4fa6557b4187 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:30.255544 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c514b0-1f41-40a7-afd6-4fa6557b4187 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:30.256050 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c514b0-1f41-40a7-afd6-4fa6557b4187 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:30.257864 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 138/272] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:46:30.263527 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16663f2f-cf26-499a-bd2a-a0a08c2b3355 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:30.263813 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16663f2f-cf26-499a-bd2a-a0a08c2b3355 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:30.264087 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16663f2f-cf26-499a-bd2a-a0a08c2b3355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:30.288468 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-16663f2f-cf26-499a-bd2a-a0a08c2b3355 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:30.289676 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-16663f2f-cf26-499a-bd2a-a0a08c2b3355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:30.323291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:30.375880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 135/273] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:30.600007 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c514b0-1f41-40a7-afd6-4fa6557b4187 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:30.709438 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c514b0-1f41-40a7-afd6-4fa6557b4187 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:30.713615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16663f2f-cf26-499a-bd2a-a0a08c2b3355 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:30.761304 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9a781-b8e4-480c-aca9-ecc1107dc823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:30.762962 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9a781-b8e4-480c-aca9-ecc1107dc823 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:30.763461 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9a781-b8e4-480c-aca9-ecc1107dc823 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:30.763950 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9a781-b8e4-480c-aca9-ecc1107dc823 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:30.765268 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9a781-b8e4-480c-aca9-ecc1107dc823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:30.766928 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9a781-b8e4-480c-aca9-ecc1107dc823 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:30.769035 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 139/274] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:46:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:30.773951 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9a781-b8e4-480c-aca9-ecc1107dc823 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:30.815308 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:30.847200 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16663f2f-cf26-499a-bd2a-a0a08c2b3355 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:30.892570 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640dc301-ca70-4c61-90b1-9ba400983aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:30.893213 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dc301-ca70-4c61-90b1-9ba400983aa7 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:30.893491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dc301-ca70-4c61-90b1-9ba400983aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:30.893782 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dc301-ca70-4c61-90b1-9ba400983aa7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:30.905979 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640dc301-ca70-4c61-90b1-9ba400983aa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:30.909195 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9a781-b8e4-480c-aca9-ecc1107dc823 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:30.911556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-640dc301-ca70-4c61-90b1-9ba400983aa7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:30.911556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:30.911556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:30.911556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:30.911556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:30.911556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:30.911556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:30.911556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:30.911556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:30.911556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:30.911556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:30.911556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:30.911556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:30.911556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:30.911556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:30.911556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:30.912647 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:30.912647 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:30.912647 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:30.912647 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:30.912647 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:30.912647 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:30.912647 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:30.912647 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:30.912647 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:30.912647 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:30.912647 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:30.912647 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:30.912647 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:30.912647 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:30.912647 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:30.912647 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:30.913690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:30.913690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:30.913690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:30.913690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:30.913690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:30.913690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:30.913690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:30.913690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:30.913690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:30.913690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:30.913690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:30.913690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:30.913690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 136/275] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:30.914521 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeeb0ac-944b-4b4c-9dcc-2cb16c6882cf None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:30.914668 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeeb0ac-944b-4b4c-9dcc-2cb16c6882cf None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:30.914925 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeeb0ac-944b-4b4c-9dcc-2cb16c6882cf None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:30.916284 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 137/276] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:30.921547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeeb0ac-944b-4b4c-9dcc-2cb16c6882cf None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:30.948440 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:30.952598 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c458f7b-f0e4-42a0-8df9-5a810045b19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:30.953535 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c458f7b-f0e4-42a0-8df9-5a810045b19d None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:30.953988 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c458f7b-f0e4-42a0-8df9-5a810045b19d None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:30.954400 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c458f7b-f0e4-42a0-8df9-5a810045b19d None admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:30.955198 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c458f7b-f0e4-42a0-8df9-5a810045b19d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:30.956769 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c458f7b-f0e4-42a0-8df9-5a810045b19d None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:30.981413 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 140/277] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 17 14:46:30 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:46:30.982449 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d22378-5e55-491e-9368-4bdb8633ba5c None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:30.982737 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d22378-5e55-491e-9368-4bdb8633ba5c None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:30.983011 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d22378-5e55-491e-9368-4bdb8633ba5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:31.003909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-a3d22378-5e55-491e-9368-4bdb8633ba5c None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:31.005101 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-a3d22378-5e55-491e-9368-4bdb8633ba5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:31.067314 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeeb0ac-944b-4b4c-9dcc-2cb16c6882cf None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:31.088821 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 141/278] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:31.099268 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a865325-92bc-4ddf-a4e6-c93c80707b26 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:31.099578 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a865325-92bc-4ddf-a4e6-c93c80707b26 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:31.099829 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a865325-92bc-4ddf-a4e6-c93c80707b26 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:31.101207 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 142/279] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:31 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:31.108531 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55494087-d7aa-4318-919d-d4e61e2945c8 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:31.108879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55494087-d7aa-4318-919d-d4e61e2945c8 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:31.109076 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55494087-d7aa-4318-919d-d4e61e2945c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:31.112908 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5886bfc-a12c-45f3-b85f-56455f3808c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:31.113845 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5886bfc-a12c-45f3-b85f-56455f3808c6 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:31.114325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5886bfc-a12c-45f3-b85f-56455f3808c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:31.114851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5886bfc-a12c-45f3-b85f-56455f3808c6 None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:31.115794 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5886bfc-a12c-45f3-b85f-56455f3808c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:31.116377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5886bfc-a12c-45f3-b85f-56455f3808c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:31.118052 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5886bfc-a12c-45f3-b85f-56455f3808c6 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:31.128438 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 138/280] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:31.134475 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-55494087-d7aa-4318-919d-d4e61e2945c8 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:31.134700 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5886bfc-a12c-45f3-b85f-56455f3808c6 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:31.136218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-55494087-d7aa-4318-919d-d4e61e2945c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:31.156965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:31.235771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 143/281] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:31.252588 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:31.268930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5886bfc-a12c-45f3-b85f-56455f3808c6 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:31.305795 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac6871-4799-43ae-aec7-27142d6cf8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:31.306431 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6871-4799-43ae-aec7-27142d6cf8f7 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:31.306820 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6871-4799-43ae-aec7-27142d6cf8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:31.307166 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6871-4799-43ae-aec7-27142d6cf8f7 None admin] PATH_INFO: `/v3/users/48e13ae1c6ea4229b6db0bb52aed3048` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:31.321648 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac6871-4799-43ae-aec7-27142d6cf8f7 None admin] RBAC: Authorizing `identity:get_user(user_id=48e13ae1c6ea4229b6db0bb52aed3048)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:31.323081 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac6871-4799-43ae-aec7-27142d6cf8f7 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:31.325119 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 139/282] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:31 2022] GET /identity/v3/users/48e13ae1c6ea4229b6db0bb52aed3048 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:31.330921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55494087-d7aa-4318-919d-d4e61e2945c8 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:31.437066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac6871-4799-43ae-aec7-27142d6cf8f7 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:31.443849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55494087-d7aa-4318-919d-d4e61e2945c8 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:31.484519 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecf0ca-c356-419e-83f2-424d179b6845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:31.485136 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecf0ca-c356-419e-83f2-424d179b6845 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:31.485512 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecf0ca-c356-419e-83f2-424d179b6845 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:31.485700 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecf0ca-c356-419e-83f2-424d179b6845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:31.486617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecf0ca-c356-419e-83f2-424d179b6845 None admin] RBAC: Adding query filter params (role.id=ab06ca80774d48a191fece38e3f335ad, user.id=48e13ae1c6ea4229b6db0bb52aed3048, scope.system=all) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:31.486927 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecf0ca-c356-419e-83f2-424d179b6845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:31.488477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecf0ca-c356-419e-83f2-424d179b6845 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:31.494575 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 144/283] 10.222.0.30 () {56 vars in 1308 bytes} [Wed Aug 17 14:46:31 2022] GET /identity/v3/role_assignments?user.id=48e13ae1c6ea4229b6db0bb52aed3048&scope.system=all&role.id=ab06ca80774d48a191fece38e3f335ad => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:31.584788 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac6871-4799-43ae-aec7-27142d6cf8f7 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:31.614326 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecf0ca-c356-419e-83f2-424d179b6845 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:31.630154 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:31.632548 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4584ed-7e7f-495c-8f22-363e00a43bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:31.633445 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4584ed-7e7f-495c-8f22-363e00a43bcb None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:31.633723 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4584ed-7e7f-495c-8f22-363e00a43bcb None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:31.634189 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4584ed-7e7f-495c-8f22-363e00a43bcb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:31.660138 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4584ed-7e7f-495c-8f22-363e00a43bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:31.664885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-fc4584ed-7e7f-495c-8f22-363e00a43bcb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:31.664885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:31.664885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:31.664885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:31.664885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:31.664885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:31.664885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:31.664885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:31.664885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:31.664885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:31.664885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:31.664885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:31.664885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:31.664885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:31.664885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:31.664885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:31.665827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:31.665827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:31.665827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:31.665827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:31.665827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:31.665827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:31.665827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:31.665827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:31.665827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:31.665827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:31.665827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:31.665827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:31.665827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:31.665827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:31.665827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:31.665827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:31.666608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:31.666608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:31.666608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:31.666608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:31.666608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:31.666608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:31.666608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:31.666608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:31.666608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:31.666608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:31.666608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:31.666608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:31.671246 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 140/284] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:31.676999 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4584ed-7e7f-495c-8f22-363e00a43bcb None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:31.689302 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:31.782576 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecf0ca-c356-419e-83f2-424d179b6845 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:31.819854 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b401ad2-24af-4e71-a09b-9b714bdb6fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:31.820510 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b401ad2-24af-4e71-a09b-9b714bdb6fd6 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:31.820861 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b401ad2-24af-4e71-a09b-9b714bdb6fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:31.821136 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b401ad2-24af-4e71-a09b-9b714bdb6fd6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:31.831700 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b401ad2-24af-4e71-a09b-9b714bdb6fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:31.836611 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-4b401ad2-24af-4e71-a09b-9b714bdb6fd6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:46:31.836611 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:31.836611 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:31.836611 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:31.836611 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:31.836611 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:31.836611 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:31.836611 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:31.836611 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:31.836611 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:31.836611 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:31.836611 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:31.836611 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:31.836611 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:31.836611 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:31.836611 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:31.837499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:31.837499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:31.837499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:31.837499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:31.837499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:31.837499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:31.837499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:31.837499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:31.837499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:31.837499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:31.837499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:31.837499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:31.837499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:31.837499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:31.837499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:31.837499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:31.838695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:31.838695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:31.838695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:31.838695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:31.838695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:31.838695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:31.838695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:31.838695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:31.838695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:31.838695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:31.838695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:46:31.838695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:46:31.838695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 145/285] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:46:31.844002 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b401ad2-24af-4e71-a09b-9b714bdb6fd6 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:31.886532 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4584ed-7e7f-495c-8f22-363e00a43bcb None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:31.920878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:31.960586 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b401ad2-24af-4e71-a09b-9b714bdb6fd6 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:31.976221 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221743a4-738e-4f1f-85b5-f1df7a51dbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:31.977541 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221743a4-738e-4f1f-85b5-f1df7a51dbff None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:31.978053 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221743a4-738e-4f1f-85b5-f1df7a51dbff None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:31.978326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221743a4-738e-4f1f-85b5-f1df7a51dbff None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:31.978995 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221743a4-738e-4f1f-85b5-f1df7a51dbff None admin] RBAC: Adding query filter params (name=member) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:31.981465 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221743a4-738e-4f1f-85b5-f1df7a51dbff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:31.983601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221743a4-738e-4f1f-85b5-f1df7a51dbff None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:32.008667 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 141/286] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:32.018864 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221743a4-738e-4f1f-85b5-f1df7a51dbff None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:32.050492 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b2a7d-062e-48ed-b0de-1c760a415591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:32.052249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b2a7d-062e-48ed-b0de-1c760a415591 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:32.052540 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b2a7d-062e-48ed-b0de-1c760a415591 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:32.052815 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b2a7d-062e-48ed-b0de-1c760a415591 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:32.053496 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b2a7d-062e-48ed-b0de-1c760a415591 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:32.056703 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b2a7d-062e-48ed-b0de-1c760a415591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:32.058132 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b2a7d-062e-48ed-b0de-1c760a415591 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:32.082065 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 146/287] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:32.099411 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b2a7d-062e-48ed-b0de-1c760a415591 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:32.153284 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:32.223752 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221743a4-738e-4f1f-85b5-f1df7a51dbff None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:32.248356 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b2a7d-062e-48ed-b0de-1c760a415591 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:32.292491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b59a84-884a-4cca-992e-646fd5d3f50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:32.294595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b59a84-884a-4cca-992e-646fd5d3f50c None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:32.294943 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b59a84-884a-4cca-992e-646fd5d3f50c None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:32.295267 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b59a84-884a-4cca-992e-646fd5d3f50c None admin] PATH_INFO: `/v3/users/ecd69bba098e4a53b4c4d08a2b85f155` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:32.297952 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b59a84-884a-4cca-992e-646fd5d3f50c None admin] RBAC: Authorizing `identity:get_user(user_id=ecd69bba098e4a53b4c4d08a2b85f155)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:32.299415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b59a84-884a-4cca-992e-646fd5d3f50c None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:32.301010 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 142/288] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:32 2022] GET /identity/v3/users/ecd69bba098e4a53b4c4d08a2b85f155 => generated 297 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:32.308088 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b59a84-884a-4cca-992e-646fd5d3f50c None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:32.311066 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:32.327184 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e521f6-dffc-438a-b54a-452de2a59948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:32.327878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e521f6-dffc-438a-b54a-452de2a59948 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:32.328163 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e521f6-dffc-438a-b54a-452de2a59948 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:32.328439 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e521f6-dffc-438a-b54a-452de2a59948 None admin] PATH_INFO: `/v3/users/3083ae1c52134f2aa91aa1895a523d70` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:32.330186 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e521f6-dffc-438a-b54a-452de2a59948 None admin] RBAC: Authorizing `identity:get_user(user_id=3083ae1c52134f2aa91aa1895a523d70)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:32.331689 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e521f6-dffc-438a-b54a-452de2a59948 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:32.333516 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 147/289] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:32 2022] GET /identity/v3/users/3083ae1c52134f2aa91aa1895a523d70 => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:32.343361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e521f6-dffc-438a-b54a-452de2a59948 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:32.474336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e521f6-dffc-438a-b54a-452de2a59948 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:32.519478 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a4ddb-de9b-4867-9915-e913e565ae38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:32.520116 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a4ddb-de9b-4867-9915-e913e565ae38 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:32.520398 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a4ddb-de9b-4867-9915-e913e565ae38 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:32.520672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a4ddb-de9b-4867-9915-e913e565ae38 None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:32.523747 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a4ddb-de9b-4867-9915-e913e565ae38 None admin] RBAC: Authorizing `identity:get_project(project_id=721977c9f4e7432d96ddc227894864f0)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:32.525199 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a4ddb-de9b-4867-9915-e913e565ae38 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:32.526855 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 148/290] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:32 2022] GET /identity/v3/projects/721977c9f4e7432d96ddc227894864f0 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:32.532749 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a4ddb-de9b-4867-9915-e913e565ae38 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:32.561767 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b59a84-884a-4cca-992e-646fd5d3f50c None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:32.619640 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0493a9-47fa-48ad-9b88-90accd64de68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:32.620256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0493a9-47fa-48ad-9b88-90accd64de68 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:32.620596 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0493a9-47fa-48ad-9b88-90accd64de68 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:32.621139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0493a9-47fa-48ad-9b88-90accd64de68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:32.626033 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:32.648958 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:32.693916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a4ddb-de9b-4867-9915-e913e565ae38 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:32.752218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95239f46-0836-4a7c-9ab2-50c34f52588f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:32.754071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95239f46-0836-4a7c-9ab2-50c34f52588f None admin] REQUEST_METHOD: `PUT` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:32.755291 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95239f46-0836-4a7c-9ab2-50c34f52588f None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:32.756502 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95239f46-0836-4a7c-9ab2-50c34f52588f None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0/users/3083ae1c52134f2aa91aa1895a523d70/roles/c04b09acf4454802a88c34604ecd7e5a` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:32.760030 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95239f46-0836-4a7c-9ab2-50c34f52588f None admin] RBAC: Authorizing `identity:create_grant(project_id=721977c9f4e7432d96ddc227894864f0, user_id=3083ae1c52134f2aa91aa1895a523d70, role_id=c04b09acf4454802a88c34604ecd7e5a)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:32.762578 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95239f46-0836-4a7c-9ab2-50c34f52588f None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:32.776345 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0493a9-47fa-48ad-9b88-90accd64de68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:32.778721 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0493a9-47fa-48ad-9b88-90accd64de68 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:32.787267 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 149/291] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 17 14:46:32 2022] PUT /identity/v3/projects/721977c9f4e7432d96ddc227894864f0/users/3083ae1c52134f2aa91aa1895a523d70/roles/c04b09acf4454802a88c34604ecd7e5a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:46:32.927414 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 143/292] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:32.933661 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95239f46-0836-4a7c-9ab2-50c34f52588f None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:33.079091 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95239f46-0836-4a7c-9ab2-50c34f52588f None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:33.109771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:33.121203 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8066e-5279-4ce6-bfd7-0e42cd90bccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:33.122716 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8066e-5279-4ce6-bfd7-0e42cd90bccd None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:33.123050 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8066e-5279-4ce6-bfd7-0e42cd90bccd None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:33.123515 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8066e-5279-4ce6-bfd7-0e42cd90bccd None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:33.124681 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8066e-5279-4ce6-bfd7-0e42cd90bccd None admin] RBAC: Authorizing `identity:get_project(project_id=721977c9f4e7432d96ddc227894864f0)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:33.126150 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8066e-5279-4ce6-bfd7-0e42cd90bccd None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:33.127807 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 150/293] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:32 2022] GET /identity/v3/projects/721977c9f4e7432d96ddc227894864f0 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:33.134153 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0493a9-47fa-48ad-9b88-90accd64de68 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:33.172009 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:33.263900 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0493a9-47fa-48ad-9b88-90accd64de68 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:33.311480 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b07a5-fcbd-4de3-a2c4-fc4f62c418c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:33.312079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b07a5-fcbd-4de3-a2c4-fc4f62c418c4 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:33.312352 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b07a5-fcbd-4de3-a2c4-fc4f62c418c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:33.312684 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b07a5-fcbd-4de3-a2c4-fc4f62c418c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:33.313588 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b07a5-fcbd-4de3-a2c4-fc4f62c418c4 None admin] RBAC: Adding query filter params (role.id=ab06ca80774d48a191fece38e3f335ad, scope.project.id=721977c9f4e7432d96ddc227894864f0, user.id=ecd69bba098e4a53b4c4d08a2b85f155) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:33.313919 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b07a5-fcbd-4de3-a2c4-fc4f62c418c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:33.315348 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b07a5-fcbd-4de3-a2c4-fc4f62c418c4 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:33.325524 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 144/294] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:46:33 2022] GET /identity/v3/role_assignments?user.id=ecd69bba098e4a53b4c4d08a2b85f155&scope.project.id=721977c9f4e7432d96ddc227894864f0&role.id=ab06ca80774d48a191fece38e3f335ad => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:33.775595 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dde67-e7bf-43a2-ba0d-77007c13088c None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:33.776108 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dde67-e7bf-43a2-ba0d-77007c13088c None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:33.776108 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dde67-e7bf-43a2-ba0d-77007c13088c None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:33.777452 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 151/295] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:33.783510 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7dd6c-db5c-496f-a8b1-2337977f004a None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:33.783925 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7dd6c-db5c-496f-a8b1-2337977f004a None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:33.784304 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7dd6c-db5c-496f-a8b1-2337977f004a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:33.803749 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-01b7dd6c-db5c-496f-a8b1-2337977f004a None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:33.804867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-01b7dd6c-db5c-496f-a8b1-2337977f004a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:33.884658 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 145/296] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:34.154419 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ab976-8727-4087-a2f0-f5c05e03854b None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:34.154419 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ab976-8727-4087-a2f0-f5c05e03854b None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:34.154419 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ab976-8727-4087-a2f0-f5c05e03854b None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:34.154419 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 152/297] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:34.160258 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a299bd-9460-4400-a328-1ce95d74aeaf None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:34.161142 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a299bd-9460-4400-a328-1ce95d74aeaf None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:34.161606 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a299bd-9460-4400-a328-1ce95d74aeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:34.164057 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62fc0e-051a-4832-af3f-6fd3af5ba66f None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:34.164340 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62fc0e-051a-4832-af3f-6fd3af5ba66f None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:34.164614 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62fc0e-051a-4832-af3f-6fd3af5ba66f None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:34.166191 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 153/298] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:46:34.171213 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210b937-fb3e-42da-b6dd-c608d7220fd8 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:34.171497 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210b937-fb3e-42da-b6dd-c608d7220fd8 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:34.171775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210b937-fb3e-42da-b6dd-c608d7220fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:34.184223 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-e3a299bd-9460-4400-a328-1ce95d74aeaf None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:34.186888 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-e3a299bd-9460-4400-a328-1ce95d74aeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:34.196150 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-8210b937-fb3e-42da-b6dd-c608d7220fd8 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:34.198132 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-8210b937-fb3e-42da-b6dd-c608d7220fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:34.213429 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:34.261831 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 146/299] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:34.262869 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a299bd-9460-4400-a328-1ce95d74aeaf None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:34.297669 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 154/300] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:46:34.374629 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a299bd-9460-4400-a328-1ce95d74aeaf None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:34.410806 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffca344-13c5-4554-ae36-49ae14eb8b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:34.411750 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffca344-13c5-4554-ae36-49ae14eb8b59 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:34.412218 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffca344-13c5-4554-ae36-49ae14eb8b59 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:34.412691 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffca344-13c5-4554-ae36-49ae14eb8b59 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:34.424224 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffca344-13c5-4554-ae36-49ae14eb8b59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:34.429098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-0ffca344-13c5-4554-ae36-49ae14eb8b59 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:46:34.429098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:34.429098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:34.429098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:34.429098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:34.429098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:34.429098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:34.429098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:34.429098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:34.429098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:34.429098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:34.429098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:34.429098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:34.429098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:34.429098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:34.429098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:34.430038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:34.430038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:34.430038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:34.430038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:34.430038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:34.430038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:34.430038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:34.430038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:34.430038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:34.430038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:34.430038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:34.430038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:34.430038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:34.430038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:34.430038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:34.430038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:34.430809 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:34.430809 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:34.430809 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:34.430809 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:34.430809 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:34.430809 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:34.430809 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:34.430809 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:34.430809 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:34.430809 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:34.430809 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:46:34.430809 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:34.432990 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 147/301] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:34.442842 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210b937-fb3e-42da-b6dd-c608d7220fd8 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:34.560754 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210b937-fb3e-42da-b6dd-c608d7220fd8 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:34.586380 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:34.599231 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0efa7-cfab-4fbc-b624-9928c04a73af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:34.599835 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0efa7-cfab-4fbc-b624-9928c04a73af None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:34.600107 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0efa7-cfab-4fbc-b624-9928c04a73af None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:34.600372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0efa7-cfab-4fbc-b624-9928c04a73af None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:34.601030 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0efa7-cfab-4fbc-b624-9928c04a73af None admin] RBAC: Adding query filter params (name=reader) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:34.601324 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0efa7-cfab-4fbc-b624-9928c04a73af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:34.604010 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0efa7-cfab-4fbc-b624-9928c04a73af None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:34.609888 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffca344-13c5-4554-ae36-49ae14eb8b59 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:34.612952 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 155/302] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:34.619206 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0efa7-cfab-4fbc-b624-9928c04a73af None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:34.634478 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:34.724362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffca344-13c5-4554-ae36-49ae14eb8b59 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:34.726818 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0efa7-cfab-4fbc-b624-9928c04a73af None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:34.761555 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c1d98-4db3-4506-b449-7431371475f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:34.762736 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c1d98-4db3-4506-b449-7431371475f2 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:34.763088 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c1d98-4db3-4506-b449-7431371475f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:34.763378 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a5343-c6d8-4ef7-aad2-96875315576b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:34.763500 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c1d98-4db3-4506-b449-7431371475f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:34.764003 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a5343-c6d8-4ef7-aad2-96875315576b None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:34.764278 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a5343-c6d8-4ef7-aad2-96875315576b None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:34.764546 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a5343-c6d8-4ef7-aad2-96875315576b None admin] PATH_INFO: `/v3/users/e84ec642a8c1476db655f36aeb0f2dab` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:34.774460 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c1d98-4db3-4506-b449-7431371475f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:34.779166 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a5343-c6d8-4ef7-aad2-96875315576b None admin] RBAC: Authorizing `identity:get_user(user_id=e84ec642a8c1476db655f36aeb0f2dab)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:34.780262 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-125c1d98-4db3-4506-b449-7431371475f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:34.780262 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:34.780262 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:34.780262 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:34.780262 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:34.780262 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:34.780262 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:34.780262 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:34.780262 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:34.780262 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:34.780262 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:34.780262 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:34.780262 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:34.780262 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:34.780262 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:34.780262 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:34.781137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:34.781137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:34.781137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:34.781137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:34.781137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:34.781137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:34.781137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:34.781137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:34.781137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:34.781137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:34.781137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:34.781137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:34.781137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:34.781137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:34.781137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:34.781137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:34.782019 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:34.782019 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:34.782019 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:34.782019 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:34.782019 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:34.782019 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:34.782019 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:34.782019 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:34.782019 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:34.782019 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:34.782019 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:34.782019 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:34.782624 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a5343-c6d8-4ef7-aad2-96875315576b None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:34.782691 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 156/303] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:34 2022] GET /identity/v3/users/e84ec642a8c1476db655f36aeb0f2dab => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:34.783495 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a5343-c6d8-4ef7-aad2-96875315576b None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:34.789605 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 148/304] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:34.789605 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c1d98-4db3-4506-b449-7431371475f2 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:34.838490 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:34.872318 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:34.896909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c1d98-4db3-4506-b449-7431371475f2 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:34.900538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a5343-c6d8-4ef7-aad2-96875315576b None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:34.933911 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d32a09-acc8-499f-a92b-bb7f9c84db28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:34.934512 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d32a09-acc8-499f-a92b-bb7f9c84db28 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:34.934792 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d32a09-acc8-499f-a92b-bb7f9c84db28 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:34.935062 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d32a09-acc8-499f-a92b-bb7f9c84db28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:34.935787 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d32a09-acc8-499f-a92b-bb7f9c84db28 None admin] RBAC: Adding query filter params (role.id=c04b09acf4454802a88c34604ecd7e5a, user.id=e84ec642a8c1476db655f36aeb0f2dab, scope.system=all) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:34.936094 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d32a09-acc8-499f-a92b-bb7f9c84db28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:34.936914 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214eb342-ba95-4395-bc10-2e7476af15f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:34.937532 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d32a09-acc8-499f-a92b-bb7f9c84db28 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:34.937643 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214eb342-ba95-4395-bc10-2e7476af15f4 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:34.937835 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214eb342-ba95-4395-bc10-2e7476af15f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:34.938103 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214eb342-ba95-4395-bc10-2e7476af15f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:34.939211 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214eb342-ba95-4395-bc10-2e7476af15f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:34.940618 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214eb342-ba95-4395-bc10-2e7476af15f4 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:34.942279 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 157/305] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:46:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:34.945910 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 149/306] 10.222.0.30 () {56 vars in 1308 bytes} [Wed Aug 17 14:46:34 2022] GET /identity/v3/role_assignments?user.id=e84ec642a8c1476db655f36aeb0f2dab&scope.system=all&role.id=c04b09acf4454802a88c34604ecd7e5a => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:34.946014 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214eb342-ba95-4395-bc10-2e7476af15f4 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:34.954185 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d32a09-acc8-499f-a92b-bb7f9c84db28 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:35.084439 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d32a09-acc8-499f-a92b-bb7f9c84db28 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:35.089557 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214eb342-ba95-4395-bc10-2e7476af15f4 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:35.109446 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:35.142039 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adb835-615a-466b-aa18-06e2136f065a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:35.142672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adb835-615a-466b-aa18-06e2136f065a None admin] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:35.142941 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adb835-615a-466b-aa18-06e2136f065a None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:35.143213 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adb835-615a-466b-aa18-06e2136f065a None admin] PATH_INFO: `/v3/groups` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:35.143856 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73adb835-615a-466b-aa18-06e2136f065a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:35.145368 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73adb835-615a-466b-aa18-06e2136f065a None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:35.145490 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fa78e-17d0-4128-99b3-fabf121ab859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:35.146229 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fa78e-17d0-4128-99b3-fabf121ab859 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:35.146544 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fa78e-17d0-4128-99b3-fabf121ab859 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:35.146819 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fa78e-17d0-4128-99b3-fabf121ab859 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:35.147515 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fa78e-17d0-4128-99b3-fabf121ab859 None admin] RBAC: Adding query filter params (name=member) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:35.147815 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fa78e-17d0-4128-99b3-fabf121ab859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:35.149350 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fa78e-17d0-4128-99b3-fabf121ab859 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:35.161357 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 158/307] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:35.167828 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fa78e-17d0-4128-99b3-fabf121ab859 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:35.171162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 150/308] 10.222.0.30 () {60 vars in 1134 bytes} [Wed Aug 17 14:46:34 2022] POST /identity/v3/groups => generated 229 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:46:35.285015 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fa78e-17d0-4128-99b3-fabf121ab859 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:35.313110 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1d4a8-3453-4ef4-bdb8-7d55ad254d68 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:35.313392 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1d4a8-3453-4ef4-bdb8-7d55ad254d68 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:35.313667 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1d4a8-3453-4ef4-bdb8-7d55ad254d68 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:35.315323 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 151/309] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:46:35.320757 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd1c91-1429-4213-8781-00decba87c9b None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:35.321033 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd1c91-1429-4213-8781-00decba87c9b None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:35.321301 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd1c91-1429-4213-8781-00decba87c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:35.325909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252be6a3-93eb-4696-8c9a-dc536514918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:35.326776 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252be6a3-93eb-4696-8c9a-dc536514918b None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:35.327194 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252be6a3-93eb-4696-8c9a-dc536514918b None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:35.327603 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252be6a3-93eb-4696-8c9a-dc536514918b None admin] PATH_INFO: `/v3/users/48e13ae1c6ea4229b6db0bb52aed3048` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:35.328694 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:35.328965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252be6a3-93eb-4696-8c9a-dc536514918b None admin] RBAC: Authorizing `identity:get_user(user_id=48e13ae1c6ea4229b6db0bb52aed3048)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:35.330479 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252be6a3-93eb-4696-8c9a-dc536514918b None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:35.332352 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 159/310] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:35 2022] GET /identity/v3/users/48e13ae1c6ea4229b6db0bb52aed3048 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:35.338294 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252be6a3-93eb-4696-8c9a-dc536514918b None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:35.345433 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-35fd1c91-1429-4213-8781-00decba87c9b None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:35.346774 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-35fd1c91-1429-4213-8781-00decba87c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:35.386564 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:35.437155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 152/311] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:46:35.463650 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252be6a3-93eb-4696-8c9a-dc536514918b None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:35.499837 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7181352-2885-447e-9233-8d47c201b82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:35.500480 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7181352-2885-447e-9233-8d47c201b82f None admin] REQUEST_METHOD: `PUT` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:35.500807 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7181352-2885-447e-9233-8d47c201b82f None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:35.501079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7181352-2885-447e-9233-8d47c201b82f None admin] PATH_INFO: `/v3/system/users/48e13ae1c6ea4229b6db0bb52aed3048/roles/ab06ca80774d48a191fece38e3f335ad` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:35.502603 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7181352-2885-447e-9233-8d47c201b82f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=48e13ae1c6ea4229b6db0bb52aed3048, role_id=ab06ca80774d48a191fece38e3f335ad)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:35.503965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7181352-2885-447e-9233-8d47c201b82f None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:35.515275 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 160/312] 10.222.0.30 () {58 vars in 1334 bytes} [Wed Aug 17 14:46:35 2022] PUT /identity/v3/system/users/48e13ae1c6ea4229b6db0bb52aed3048/roles/ab06ca80774d48a191fece38e3f335ad => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:46:35.784442 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd1c91-1429-4213-8781-00decba87c9b None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:35.888624 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd1c91-1429-4213-8781-00decba87c9b None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:35.919490 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:35.926415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f864db-a07c-4ed0-b67d-7531a334de53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:35.926957 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f864db-a07c-4ed0-b67d-7531a334de53 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:35.927513 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f864db-a07c-4ed0-b67d-7531a334de53 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:35.927781 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f864db-a07c-4ed0-b67d-7531a334de53 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:35.942550 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f864db-a07c-4ed0-b67d-7531a334de53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:35.947451 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-35f864db-a07c-4ed0-b67d-7531a334de53 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:46:35.947451 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:35.947451 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:35.947451 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:35.947451 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:35.947451 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:35.947451 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:35.947451 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:35.947451 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:35.947451 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:35.947451 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:35.947451 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:35.947451 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:35.947451 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:35.947451 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:35.947451 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:35.948319 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:35.948319 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:35.948319 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:35.948319 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:35.948319 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:35.948319 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:35.948319 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:35.948319 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:35.948319 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:35.948319 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:35.948319 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:35.948319 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:35.948319 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:35.948319 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:35.948319 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:35.948319 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:35.949104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:35.949104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:35.949104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:35.949104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:35.949104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:35.949104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:35.949104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:35.949104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:35.949104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:35.949104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:35.949104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:46:35.949104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:35.949104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 153/313] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:35.958856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7181352-2885-447e-9233-8d47c201b82f None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:36.067477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7181352-2885-447e-9233-8d47c201b82f None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:36.074699 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:36.102946 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258769b-dee7-40ac-8623-698226487e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:36.103594 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258769b-dee7-40ac-8623-698226487e2b None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:36.104222 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258769b-dee7-40ac-8623-698226487e2b None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:36.104846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258769b-dee7-40ac-8623-698226487e2b None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:36.105514 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258769b-dee7-40ac-8623-698226487e2b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:36.110140 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258769b-dee7-40ac-8623-698226487e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:36.111715 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258769b-dee7-40ac-8623-698226487e2b None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:36.121073 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 161/314] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:36.127205 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f864db-a07c-4ed0-b67d-7531a334de53 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:36.233870 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f864db-a07c-4ed0-b67d-7531a334de53 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:36.270559 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45256d-8c37-4dd8-8560-66e3d3bbfd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:36.271531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45256d-8c37-4dd8-8560-66e3d3bbfd98 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:36.272050 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45256d-8c37-4dd8-8560-66e3d3bbfd98 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:36.272511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45256d-8c37-4dd8-8560-66e3d3bbfd98 None admin] PATH_INFO: `/v3/users/3083ae1c52134f2aa91aa1895a523d70` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:36.273902 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45256d-8c37-4dd8-8560-66e3d3bbfd98 None admin] RBAC: Authorizing `identity:get_user(user_id=3083ae1c52134f2aa91aa1895a523d70)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:36.275593 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45256d-8c37-4dd8-8560-66e3d3bbfd98 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:36.277360 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 154/315] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:36 2022] GET /identity/v3/users/3083ae1c52134f2aa91aa1895a523d70 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:36.283616 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258769b-dee7-40ac-8623-698226487e2b None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:36.394171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258769b-dee7-40ac-8623-698226487e2b None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:36.428953 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ac56a-ea0b-4b91-a4d9-037a0ac54400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:36.429558 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ac56a-ea0b-4b91-a4d9-037a0ac54400 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:36.429862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ac56a-ea0b-4b91-a4d9-037a0ac54400 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:36.430133 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ac56a-ea0b-4b91-a4d9-037a0ac54400 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:36.468830 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:36.504022 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ac56a-ea0b-4b91-a4d9-037a0ac54400 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:36.505470 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ac56a-ea0b-4b91-a4d9-037a0ac54400 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:36.618543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 162/316] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:36.626193 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45256d-8c37-4dd8-8560-66e3d3bbfd98 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:36.694217 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:36.738834 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45256d-8c37-4dd8-8560-66e3d3bbfd98 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:36.774200 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21353a-8b95-4ff9-9273-06a2432de038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:36.774826 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21353a-8b95-4ff9-9273-06a2432de038 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:36.775104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21353a-8b95-4ff9-9273-06a2432de038 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:36.775430 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21353a-8b95-4ff9-9273-06a2432de038 None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:36.776560 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21353a-8b95-4ff9-9273-06a2432de038 None admin] RBAC: Authorizing `identity:get_project(project_id=721977c9f4e7432d96ddc227894864f0)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:36.778632 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21353a-8b95-4ff9-9273-06a2432de038 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:36.780566 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 155/317] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:36 2022] GET /identity/v3/projects/721977c9f4e7432d96ddc227894864f0 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:36.786274 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ac56a-ea0b-4b91-a4d9-037a0ac54400 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:36.860366 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:36.895777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ac56a-ea0b-4b91-a4d9-037a0ac54400 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:36.930741 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4412088-8219-4d21-9c2d-eadd1c1192ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:36.931341 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4412088-8219-4d21-9c2d-eadd1c1192ac None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:36.931614 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4412088-8219-4d21-9c2d-eadd1c1192ac None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:36.931884 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4412088-8219-4d21-9c2d-eadd1c1192ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:36.932603 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4412088-8219-4d21-9c2d-eadd1c1192ac None admin] RBAC: Adding query filter params (role.id=c04b09acf4454802a88c34604ecd7e5a, scope.project.id=721977c9f4e7432d96ddc227894864f0, user.id=3083ae1c52134f2aa91aa1895a523d70) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:36.932905 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4412088-8219-4d21-9c2d-eadd1c1192ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:36.934762 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4412088-8219-4d21-9c2d-eadd1c1192ac None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:36.941333 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 163/318] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:46:36 2022] GET /identity/v3/role_assignments?user.id=3083ae1c52134f2aa91aa1895a523d70&scope.project.id=721977c9f4e7432d96ddc227894864f0&role.id=c04b09acf4454802a88c34604ecd7e5a => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:37.310253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b052a-0a54-4acf-8185-1bcc536c52f9 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:37.310765 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b052a-0a54-4acf-8185-1bcc536c52f9 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:37.310765 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b052a-0a54-4acf-8185-1bcc536c52f9 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:37.312245 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 156/319] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:37.317267 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0789b1d-f67d-4e44-adc6-0df4e3e8331b None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:37.317642 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0789b1d-f67d-4e44-adc6-0df4e3e8331b None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:37.317822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0789b1d-f67d-4e44-adc6-0df4e3e8331b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:37.336413 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-e0789b1d-f67d-4e44-adc6-0df4e3e8331b None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:37.337582 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-e0789b1d-f67d-4e44-adc6-0df4e3e8331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:37.413192 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 164/320] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:37.566066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6510e-01b0-417e-96f3-64887e435b22 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:37.566291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6510e-01b0-417e-96f3-64887e435b22 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:37.566553 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6510e-01b0-417e-96f3-64887e435b22 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:37.567880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 157/321] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:37.573031 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31324f6d-5e09-4ca3-9843-a0d7d19715b4 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:37.573387 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31324f6d-5e09-4ca3-9843-a0d7d19715b4 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:37.573757 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31324f6d-5e09-4ca3-9843-a0d7d19715b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:37.592429 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-31324f6d-5e09-4ca3-9843-a0d7d19715b4 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:37.593622 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-31324f6d-5e09-4ca3-9843-a0d7d19715b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:37.656947 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:37.669777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 165/322] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:37.742888 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6510e-01b0-417e-96f3-64887e435b22 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:37.834454 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9363a1d-cb5f-4e06-943c-db57ecf723b7 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:37.834655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9363a1d-cb5f-4e06-943c-db57ecf723b7 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:37.834904 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9363a1d-cb5f-4e06-943c-db57ecf723b7 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:37.836366 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 166/323] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:46:37.841171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2e783-bd6f-435b-b396-169bf2dbb057 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:37.841459 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2e783-bd6f-435b-b396-169bf2dbb057 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:37.841753 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2e783-bd6f-435b-b396-169bf2dbb057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:37.849100 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6510e-01b0-417e-96f3-64887e435b22 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:37.861359 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-37e2e783-bd6f-435b-b396-169bf2dbb057 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:37.862583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-37e2e783-bd6f-435b-b396-169bf2dbb057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:37.881744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:37.891206 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f316956-3e6a-4d94-9541-3a2a064ead5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:37.891826 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f316956-3e6a-4d94-9541-3a2a064ead5d None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:37.892171 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f316956-3e6a-4d94-9541-3a2a064ead5d None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:37.892427 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f316956-3e6a-4d94-9541-3a2a064ead5d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:37.904422 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f316956-3e6a-4d94-9541-3a2a064ead5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:37.909107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-9f316956-3e6a-4d94-9541-3a2a064ead5d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:46:37.909107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:37.909107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:37.909107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:37.909107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:37.909107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:37.909107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:37.909107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:37.909107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:37.909107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:37.909107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:37.909107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:37.909107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:37.909107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:37.909107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:37.909107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:37.910008 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:37.910008 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:37.910008 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:37.910008 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:37.910008 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:37.910008 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:37.910008 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:37.910008 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:37.910008 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:37.910008 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:37.910008 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:37.910008 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:37.910008 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:37.910008 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:37.910008 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:37.910008 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:37.911182 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:37.911182 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:37.911182 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:37.911182 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:37.911182 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:37.911182 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:37.911182 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:37.911182 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:37.911182 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:37.911182 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:37.911182 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:46:37.911182 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:37.911182 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 158/324] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:37.915881 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f316956-3e6a-4d94-9541-3a2a064ead5d None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:37.945765 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 167/325] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:46:37.996024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2e783-bd6f-435b-b396-169bf2dbb057 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:38.028654 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f316956-3e6a-4d94-9541-3a2a064ead5d None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:38.067213 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103bed4-2e47-4ecf-9de1-89ac6b8c13ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:38.067801 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103bed4-2e47-4ecf-9de1-89ac6b8c13ff None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:38.068128 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103bed4-2e47-4ecf-9de1-89ac6b8c13ff None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:38.068399 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103bed4-2e47-4ecf-9de1-89ac6b8c13ff None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:38.069055 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103bed4-2e47-4ecf-9de1-89ac6b8c13ff None admin] RBAC: Adding query filter params (name=reader) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:38.069354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103bed4-2e47-4ecf-9de1-89ac6b8c13ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:38.070758 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103bed4-2e47-4ecf-9de1-89ac6b8c13ff None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:38.085248 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 159/326] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:38.086528 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103bed4-2e47-4ecf-9de1-89ac6b8c13ff None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:38.103342 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2e783-bd6f-435b-b396-169bf2dbb057 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:38.127582 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:38.141792 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:38.144136 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32ade2-11a8-4cd2-b6a0-7a58d5eb5658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:38.145045 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32ade2-11a8-4cd2-b6a0-7a58d5eb5658 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:38.145649 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32ade2-11a8-4cd2-b6a0-7a58d5eb5658 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:38.146118 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32ade2-11a8-4cd2-b6a0-7a58d5eb5658 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:38.149499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32ade2-11a8-4cd2-b6a0-7a58d5eb5658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:38.150956 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32ade2-11a8-4cd2-b6a0-7a58d5eb5658 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:38.152835 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 168/327] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:46:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:38.158379 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32ade2-11a8-4cd2-b6a0-7a58d5eb5658 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:38.198546 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103bed4-2e47-4ecf-9de1-89ac6b8c13ff None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:38.233575 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb9c05-fd20-4d75-a57b-a2b995b0de38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:38.234236 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb9c05-fd20-4d75-a57b-a2b995b0de38 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:38.234510 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb9c05-fd20-4d75-a57b-a2b995b0de38 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:38.234777 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb9c05-fd20-4d75-a57b-a2b995b0de38 None admin] PATH_INFO: `/v3/users/e84ec642a8c1476db655f36aeb0f2dab` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:38.235889 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb9c05-fd20-4d75-a57b-a2b995b0de38 None admin] RBAC: Authorizing `identity:get_user(user_id=e84ec642a8c1476db655f36aeb0f2dab)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:38.237308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb9c05-fd20-4d75-a57b-a2b995b0de38 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:38.239120 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 160/328] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:38 2022] GET /identity/v3/users/e84ec642a8c1476db655f36aeb0f2dab => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:38.244269 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb9c05-fd20-4d75-a57b-a2b995b0de38 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:38.266739 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32ade2-11a8-4cd2-b6a0-7a58d5eb5658 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:38.302381 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709fff0-e552-468a-a942-2eab98db2521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:38.302983 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709fff0-e552-468a-a942-2eab98db2521 None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:38.303260 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709fff0-e552-468a-a942-2eab98db2521 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:38.303527 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709fff0-e552-468a-a942-2eab98db2521 None admin] PATH_INFO: `/v3/groups` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:38.304150 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709fff0-e552-468a-a942-2eab98db2521 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:38.305554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709fff0-e552-468a-a942-2eab98db2521 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:38.321253 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 169/329] 10.222.0.30 () {60 vars in 1134 bytes} [Wed Aug 17 14:46:38 2022] POST /identity/v3/groups => generated 226 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:46:38.331890 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709fff0-e552-468a-a942-2eab98db2521 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:38.354389 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb9c05-fd20-4d75-a57b-a2b995b0de38 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:38.375619 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:38.381547 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:38.398176 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5af6e9-e349-49f2-90c8-613f0d8094c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:38.398930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5af6e9-e349-49f2-90c8-613f0d8094c1 None admin] REQUEST_METHOD: `PUT` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:38.399212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5af6e9-e349-49f2-90c8-613f0d8094c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:38.399485 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5af6e9-e349-49f2-90c8-613f0d8094c1 None admin] PATH_INFO: `/v3/system/users/e84ec642a8c1476db655f36aeb0f2dab/roles/c04b09acf4454802a88c34604ecd7e5a` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:38.400999 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5af6e9-e349-49f2-90c8-613f0d8094c1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e84ec642a8c1476db655f36aeb0f2dab, role_id=c04b09acf4454802a88c34604ecd7e5a)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:38.402593 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5af6e9-e349-49f2-90c8-613f0d8094c1 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:38.413567 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 161/330] 10.222.0.30 () {58 vars in 1334 bytes} [Wed Aug 17 14:46:38 2022] PUT /identity/v3/system/users/e84ec642a8c1476db655f36aeb0f2dab/roles/c04b09acf4454802a88c34604ecd7e5a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:46:38.446376 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709fff0-e552-468a-a942-2eab98db2521 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:38.487243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32097f-24bd-4323-9051-60c57c7a879b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:38.487904 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32097f-24bd-4323-9051-60c57c7a879b None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:38.488182 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32097f-24bd-4323-9051-60c57c7a879b None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:38.488455 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32097f-24bd-4323-9051-60c57c7a879b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:38.502244 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32097f-24bd-4323-9051-60c57c7a879b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:38.507723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-1f32097f-24bd-4323-9051-60c57c7a879b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:38.507723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:38.507723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:38.507723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:38.507723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:38.507723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:38.507723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:38.507723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:38.507723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:38.507723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:38.507723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:38.507723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:38.507723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:38.507723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:38.507723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:38.507723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:38.508845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:38.508845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:38.508845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:38.508845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:38.508845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:38.508845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:38.508845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:38.508845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:38.508845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:38.508845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:38.508845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:38.508845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:38.508845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:38.508845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:38.508845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:38.508845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:38.509653 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:38.509653 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:38.509653 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:38.509653 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:38.509653 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:38.509653 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:38.509653 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:38.509653 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:38.509653 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:38.509653 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:38.509653 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:38.509653 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:46:38.509653 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 170/331] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:38.516115 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5af6e9-e349-49f2-90c8-613f0d8094c1 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:38.633594 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5af6e9-e349-49f2-90c8-613f0d8094c1 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:38.672897 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0245ac8-e8a4-4f2e-98c7-906f6d52b419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:38.673503 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0245ac8-e8a4-4f2e-98c7-906f6d52b419 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:38.673851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0245ac8-e8a4-4f2e-98c7-906f6d52b419 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:38.674101 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0245ac8-e8a4-4f2e-98c7-906f6d52b419 None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:38.674772 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0245ac8-e8a4-4f2e-98c7-906f6d52b419 None admin] RBAC: Adding query filter params (name=member) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:38.675076 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0245ac8-e8a4-4f2e-98c7-906f6d52b419 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:38.676438 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0245ac8-e8a4-4f2e-98c7-906f6d52b419 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:38.689821 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 162/332] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:38.691690 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32097f-24bd-4323-9051-60c57c7a879b None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:38.813141 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32097f-24bd-4323-9051-60c57c7a879b None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:38.824321 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:38.852383 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdaef57-e21b-4d47-ab76-57ee07656937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:38.853045 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdaef57-e21b-4d47-ab76-57ee07656937 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:38.853325 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdaef57-e21b-4d47-ab76-57ee07656937 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:38.853616 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdaef57-e21b-4d47-ab76-57ee07656937 None admin] PATH_INFO: `/v3/users/48e13ae1c6ea4229b6db0bb52aed3048` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:38.854877 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdaef57-e21b-4d47-ab76-57ee07656937 None admin] RBAC: Authorizing `identity:get_user(user_id=48e13ae1c6ea4229b6db0bb52aed3048)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:38.857036 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdaef57-e21b-4d47-ab76-57ee07656937 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:38.858846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 171/333] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:38 2022] GET /identity/v3/users/48e13ae1c6ea4229b6db0bb52aed3048 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:38.864566 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0245ac8-e8a4-4f2e-98c7-906f6d52b419 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:38.916743 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:38.989357 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0245ac8-e8a4-4f2e-98c7-906f6d52b419 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:39.030506 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2d403-af91-426d-b7b7-2ff5fa0b3daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:39.031493 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2d403-af91-426d-b7b7-2ff5fa0b3daf None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:39.032061 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2d403-af91-426d-b7b7-2ff5fa0b3daf None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:39.032524 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2d403-af91-426d-b7b7-2ff5fa0b3daf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:39.033450 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2d403-af91-426d-b7b7-2ff5fa0b3daf None admin] RBAC: Adding query filter params (role.id=ab06ca80774d48a191fece38e3f335ad, user.id=48e13ae1c6ea4229b6db0bb52aed3048, scope.system=all) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:39.033980 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2d403-af91-426d-b7b7-2ff5fa0b3daf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:39.035615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2d403-af91-426d-b7b7-2ff5fa0b3daf None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:39.054588 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 163/334] 10.222.0.30 () {56 vars in 1308 bytes} [Wed Aug 17 14:46:38 2022] GET /identity/v3/role_assignments?user.id=48e13ae1c6ea4229b6db0bb52aed3048&scope.system=all&role.id=ab06ca80774d48a191fece38e3f335ad => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:40.838301 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9fd8b-1c71-4676-9280-152969fc5fec None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:40.839288 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9fd8b-1c71-4676-9280-152969fc5fec None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:40.839835 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9fd8b-1c71-4676-9280-152969fc5fec None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:40.841477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 172/335] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:40.847101 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587ab2f-8342-4e35-8923-1c5ad4930aa8 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:40.847963 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587ab2f-8342-4e35-8923-1c5ad4930aa8 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:40.848441 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587ab2f-8342-4e35-8923-1c5ad4930aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:40.867587 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-e587ab2f-8342-4e35-8923-1c5ad4930aa8 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:40.869111 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-e587ab2f-8342-4e35-8923-1c5ad4930aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:40.920962 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3ea6b-98c8-4e66-9bd5-24f85d2e06d4 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:40.921293 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3ea6b-98c8-4e66-9bd5-24f85d2e06d4 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:40.921519 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3ea6b-98c8-4e66-9bd5-24f85d2e06d4 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:40.924625 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 173/336] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:40.938768 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b9794-b95b-4ae5-b79b-5f29b465cc00 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:40.939041 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b9794-b95b-4ae5-b79b-5f29b465cc00 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:40.939319 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b9794-b95b-4ae5-b79b-5f29b465cc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:40.952475 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 164/337] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:40.971443 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-d74b9794-b95b-4ae5-b79b-5f29b465cc00 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:40.972630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-d74b9794-b95b-4ae5-b79b-5f29b465cc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:41.072545 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 174/338] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:46:41.540755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587ab2f-8342-4e35-8923-1c5ad4930aa8 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:41.589941 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:41.620625 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b9794-b95b-4ae5-b79b-5f29b465cc00 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:41.694224 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587ab2f-8342-4e35-8923-1c5ad4930aa8 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:41.762269 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbf2d7-e013-4d7f-9568-39848ec9b9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:41.762946 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbf2d7-e013-4d7f-9568-39848ec9b9c5 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:41.763224 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbf2d7-e013-4d7f-9568-39848ec9b9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:41.763494 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbf2d7-e013-4d7f-9568-39848ec9b9c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:41.779871 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbf2d7-e013-4d7f-9568-39848ec9b9c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:41.784394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-c2fbf2d7-e013-4d7f-9568-39848ec9b9c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:46:41.784394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:41.784394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:41.784394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:41.784394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:41.784394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:41.784394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:41.784394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:41.784394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:41.784394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:41.784394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:41.784394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:41.784394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:41.784394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:41.784394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:41.784394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:41.785290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:41.785290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:41.785290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:41.785290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:41.785290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:41.785290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:41.785290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:41.785290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:41.785290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:41.785290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:41.785290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:41.785290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:41.785290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:41.785290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:41.785290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:41.785290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:41.786135 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:41.786135 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:41.786135 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:41.786135 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:41.786135 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:41.786135 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:41.786135 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:41.786135 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:41.786135 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:41.786135 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:41.786135 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:46:41.786135 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:41.786135 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 165/339] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:41.787243 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c4320-d3d7-4960-b320-6e652943c7ba None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:41.787243 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c4320-d3d7-4960-b320-6e652943c7ba None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:41.787520 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c4320-d3d7-4960-b320-6e652943c7ba None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:41.789024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 166/340] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:41.797830 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8bdff-e2a2-4f1e-966f-b9237f5c7c2f None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:41.797830 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8bdff-e2a2-4f1e-966f-b9237f5c7c2f None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:41.797830 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8bdff-e2a2-4f1e-966f-b9237f5c7c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:41.817785 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b9794-b95b-4ae5-b79b-5f29b465cc00 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:41.820233 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-dbc8bdff-e2a2-4f1e-966f-b9237f5c7c2f None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:41.821430 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-dbc8bdff-e2a2-4f1e-966f-b9237f5c7c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:41.842162 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:41.889544 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0918c7-dd41-4524-9d66-87276c7e6e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:41.891156 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0918c7-dd41-4524-9d66-87276c7e6e9b None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:41.891440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0918c7-dd41-4524-9d66-87276c7e6e9b None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:41.891710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0918c7-dd41-4524-9d66-87276c7e6e9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:41.904926 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0918c7-dd41-4524-9d66-87276c7e6e9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:41.909710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-3e0918c7-dd41-4524-9d66-87276c7e6e9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:41.909710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:41.909710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:41.909710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:41.909710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:41.909710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:41.909710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:41.909710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:41.909710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:41.909710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:41.909710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:41.909710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:41.909710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:41.909710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:41.909710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:41.909710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:41.910613 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:41.910613 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:41.910613 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:41.910613 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:41.910613 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:41.910613 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:41.910613 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:41.910613 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:41.910613 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:41.910613 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:41.910613 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:41.910613 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:41.910613 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:41.910613 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:41.910613 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:41.910613 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:41.911797 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:41.911797 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:41.911797 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:41.911797 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:41.911797 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:41.911797 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:41.911797 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:41.911797 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:41.911797 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:41.911797 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:41.911797 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:41.911797 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:46:41.911797 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 175/341] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:41.912465 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0918c7-dd41-4524-9d66-87276c7e6e9b None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:41.930730 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 167/342] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:41.932000 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57804c6b-3879-4d1c-834a-0c2dc3445f16 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:41.932364 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57804c6b-3879-4d1c-834a-0c2dc3445f16 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:41.932532 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57804c6b-3879-4d1c-834a-0c2dc3445f16 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:41.933861 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 168/343] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:41.934622 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57804c6b-3879-4d1c-834a-0c2dc3445f16 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:41.961882 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:42.054598 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57804c6b-3879-4d1c-834a-0c2dc3445f16 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:42.128188 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e021aa-9566-4a90-8cb2-35b0eb2afe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:42.129191 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e021aa-9566-4a90-8cb2-35b0eb2afe19 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:42.130689 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e021aa-9566-4a90-8cb2-35b0eb2afe19 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:42.130689 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e021aa-9566-4a90-8cb2-35b0eb2afe19 None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:42.130689 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e021aa-9566-4a90-8cb2-35b0eb2afe19 None admin] RBAC: Adding query filter params (name=member) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:42.130906 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e021aa-9566-4a90-8cb2-35b0eb2afe19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:42.132295 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e021aa-9566-4a90-8cb2-35b0eb2afe19 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:42.147434 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0918c7-dd41-4524-9d66-87276c7e6e9b None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:42.157659 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 169/344] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:42.158937 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26387f-cdfa-448b-a395-7aa513b0eb93 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:42.159216 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26387f-cdfa-448b-a395-7aa513b0eb93 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:42.159489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26387f-cdfa-448b-a395-7aa513b0eb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:42.200917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-6e26387f-cdfa-448b-a395-7aa513b0eb93 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:42.202138 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-6e26387f-cdfa-448b-a395-7aa513b0eb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:42.212865 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b731aa-69b3-4719-8c54-7631159ce7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:42.213475 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b731aa-69b3-4719-8c54-7631159ce7e7 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:42.213771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b731aa-69b3-4719-8c54-7631159ce7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:42.214220 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b731aa-69b3-4719-8c54-7631159ce7e7 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:42.215133 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b731aa-69b3-4719-8c54-7631159ce7e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:42.215533 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b731aa-69b3-4719-8c54-7631159ce7e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:42.217237 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b731aa-69b3-4719-8c54-7631159ce7e7 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:42.229039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 176/345] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:42.230049 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b731aa-69b3-4719-8c54-7631159ce7e7 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:42.276903 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:42.328729 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 170/346] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:42.329510 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26387f-cdfa-448b-a395-7aa513b0eb93 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:42.366248 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:42.427393 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b731aa-69b3-4719-8c54-7631159ce7e7 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:42.495524 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211b631-b8cd-4dfc-9586-b8bf76314cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:42.497445 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211b631-b8cd-4dfc-9586-b8bf76314cad None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:42.497963 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211b631-b8cd-4dfc-9586-b8bf76314cad None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:42.498433 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211b631-b8cd-4dfc-9586-b8bf76314cad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:42.533963 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26387f-cdfa-448b-a395-7aa513b0eb93 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:42.578504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ca6c9-265a-4f97-98f9-75c863b97482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:42.579198 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ca6c9-265a-4f97-98f9-75c863b97482 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:42.579415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ca6c9-265a-4f97-98f9-75c863b97482 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:42.579682 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ca6c9-265a-4f97-98f9-75c863b97482 None admin] PATH_INFO: `/v3/users/e84ec642a8c1476db655f36aeb0f2dab` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:42.583933 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ca6c9-265a-4f97-98f9-75c863b97482 None admin] RBAC: Authorizing `identity:get_user(user_id=e84ec642a8c1476db655f36aeb0f2dab)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:42.585358 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ca6c9-265a-4f97-98f9-75c863b97482 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:42.589904 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 171/347] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Aug 17 14:46:42 2022] GET /identity/v3/users/e84ec642a8c1476db655f36aeb0f2dab => generated 293 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:42.591199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ca6c9-265a-4f97-98f9-75c863b97482 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:42.598511 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211b631-b8cd-4dfc-9586-b8bf76314cad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:42.599949 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211b631-b8cd-4dfc-9586-b8bf76314cad None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:42.632803 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:42.703603 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:42.721259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 177/348] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:42.722473 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211b631-b8cd-4dfc-9586-b8bf76314cad None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:42.726131 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ca6c9-265a-4f97-98f9-75c863b97482 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:42.771806 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fed796-f1ae-4bf6-b44d-8a0fb9aee77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:42.772819 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fed796-f1ae-4bf6-b44d-8a0fb9aee77e None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:42.773303 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fed796-f1ae-4bf6-b44d-8a0fb9aee77e None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:42.773809 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fed796-f1ae-4bf6-b44d-8a0fb9aee77e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:42.796836 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fed796-f1ae-4bf6-b44d-8a0fb9aee77e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:42.804469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-83fed796-f1ae-4bf6-b44d-8a0fb9aee77e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:42.804469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:42.804469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:42.804469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:42.804469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:42.804469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:42.804469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:42.804469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:42.804469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:42.804469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:42.804469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:42.804469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:42.804469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:42.804469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:42.804469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:42.804469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:42.805420 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:42.805420 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:42.805420 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:42.805420 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:42.805420 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:42.805420 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:42.805420 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:42.805420 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:42.805420 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:42.805420 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:42.805420 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:42.805420 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:42.805420 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:42.805420 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:42.805420 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:42.805420 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:42.806311 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:42.806311 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:42.806311 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:42.806311 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:42.806311 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:42.806311 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:42.806311 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:42.806311 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:42.806311 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:42.806311 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:42.806311 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:42.806311 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:42.810087 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 172/349] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:46:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:42.812672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fed796-f1ae-4bf6-b44d-8a0fb9aee77e None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:42.879307 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211b631-b8cd-4dfc-9586-b8bf76314cad None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:42.918513 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:42.926023 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7a2a5-c7c0-4894-baf5-64c6ce53af47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:42.926632 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7a2a5-c7c0-4894-baf5-64c6ce53af47 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:42.926910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7a2a5-c7c0-4894-baf5-64c6ce53af47 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:42.927180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7a2a5-c7c0-4894-baf5-64c6ce53af47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:42.927983 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7a2a5-c7c0-4894-baf5-64c6ce53af47 None admin] RBAC: Adding query filter params (role.id=c04b09acf4454802a88c34604ecd7e5a, user.id=e84ec642a8c1476db655f36aeb0f2dab, scope.system=all) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:42.928294 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7a2a5-c7c0-4894-baf5-64c6ce53af47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:42.930007 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7a2a5-c7c0-4894-baf5-64c6ce53af47 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:42.951024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 178/350] 10.222.0.30 () {56 vars in 1308 bytes} [Wed Aug 17 14:46:42 2022] GET /identity/v3/role_assignments?user.id=e84ec642a8c1476db655f36aeb0f2dab&scope.system=all&role.id=c04b09acf4454802a88c34604ecd7e5a => generated 510 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:42.952368 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7a2a5-c7c0-4894-baf5-64c6ce53af47 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:42.976605 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fed796-f1ae-4bf6-b44d-8a0fb9aee77e None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:43.023242 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69357d4-6ef1-4852-be1c-eea5fc03062e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:43.023818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69357d4-6ef1-4852-be1c-eea5fc03062e None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:43.024055 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69357d4-6ef1-4852-be1c-eea5fc03062e None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:43.024334 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69357d4-6ef1-4852-be1c-eea5fc03062e None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:43.025477 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69357d4-6ef1-4852-be1c-eea5fc03062e None admin] RBAC: Authorizing `identity:get_project(project_id=a7643b24b47f42eab63dd25e22c5cdb2)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:43.026970 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69357d4-6ef1-4852-be1c-eea5fc03062e None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:43.034168 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 173/351] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:42 2022] GET /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:43.035423 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69357d4-6ef1-4852-be1c-eea5fc03062e None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:43.065091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:43.077660 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7a2a5-c7c0-4894-baf5-64c6ce53af47 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:43.125418 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98948c8-5457-47a3-917d-369137d06fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:43.126069 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98948c8-5457-47a3-917d-369137d06fdb None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:43.126354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98948c8-5457-47a3-917d-369137d06fdb None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:43.126627 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98948c8-5457-47a3-917d-369137d06fdb None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:43.127316 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98948c8-5457-47a3-917d-369137d06fdb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:43.127618 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98948c8-5457-47a3-917d-369137d06fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:43.129006 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98948c8-5457-47a3-917d-369137d06fdb None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:43.150269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 179/352] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:46:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:43.152031 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98948c8-5457-47a3-917d-369137d06fdb None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:43.233888 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:43.253565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69357d4-6ef1-4852-be1c-eea5fc03062e None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:43.301136 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a703d-257f-4ef4-8f63-524f7e1a4970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:43.301638 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98948c8-5457-47a3-917d-369137d06fdb None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:43.301840 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a703d-257f-4ef4-8f63-524f7e1a4970 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:43.302077 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a703d-257f-4ef4-8f63-524f7e1a4970 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:43.302351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a703d-257f-4ef4-8f63-524f7e1a4970 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:43.317940 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a703d-257f-4ef4-8f63-524f7e1a4970 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:43.327786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-799a703d-257f-4ef4-8f63-524f7e1a4970 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:43.327786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:43.327786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:43.327786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:43.327786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:43.327786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:43.327786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:43.327786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:43.327786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:43.327786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:43.327786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:43.327786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:43.327786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:43.327786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:43.327786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:43.327786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:43.328715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:43.328715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:43.328715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:43.328715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:43.328715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:43.328715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:43.328715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:43.328715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:43.328715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:43.328715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:43.328715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:43.328715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:43.328715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:43.328715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:43.328715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:43.328715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:43.329496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:43.329496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:43.329496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:43.329496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:43.329496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:43.329496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:43.329496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:43.329496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:43.329496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:43.329496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:43.329496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:43.329496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:43.329496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 174/353] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:43.329496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a703d-257f-4ef4-8f63-524f7e1a4970 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:43.359220 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd7672-083a-4bee-bc4c-3d494c403121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:43.360088 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd7672-083a-4bee-bc4c-3d494c403121 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:43.360217 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd7672-083a-4bee-bc4c-3d494c403121 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:43.360384 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd7672-083a-4bee-bc4c-3d494c403121 None admin] PATH_INFO: `/v3/groups/3487e9172588429c83a62be3c43ce767` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:43.367790 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd7672-083a-4bee-bc4c-3d494c403121 None admin] RBAC: Authorizing `identity:get_group(group_id=3487e9172588429c83a62be3c43ce767)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:43.369241 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd7672-083a-4bee-bc4c-3d494c403121 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:43.371261 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 180/354] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 17 14:46:43 2022] GET /identity/v3/groups/3487e9172588429c83a62be3c43ce767 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:43.374948 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccad562-5101-4563-8688-db98d68a2f99 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:43.374948 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccad562-5101-4563-8688-db98d68a2f99 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:43.374948 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccad562-5101-4563-8688-db98d68a2f99 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:43.375618 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 181/355] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:43.377550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccad562-5101-4563-8688-db98d68a2f99 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:43.413504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:43.468397 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a703d-257f-4ef4-8f63-524f7e1a4970 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:43.509877 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccad562-5101-4563-8688-db98d68a2f99 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:43.527482 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c8b6c-dd4c-4308-b365-b5f1cd80c98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:43.528364 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c8b6c-dd4c-4308-b365-b5f1cd80c98f None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:43.528774 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c8b6c-dd4c-4308-b365-b5f1cd80c98f None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:43.529910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:43.530414 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c8b6c-dd4c-4308-b365-b5f1cd80c98f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:43.571954 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d25b1-9bf2-42d0-b206-262406f132f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:43.572839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d25b1-9bf2-42d0-b206-262406f132f1 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:43.573275 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d25b1-9bf2-42d0-b206-262406f132f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:43.573545 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d25b1-9bf2-42d0-b206-262406f132f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:43.574915 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d25b1-9bf2-42d0-b206-262406f132f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:43.575218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d25b1-9bf2-42d0-b206-262406f132f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:43.576594 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d25b1-9bf2-42d0-b206-262406f132f1 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:43.587098 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 182/356] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:43.590625 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c30bf9-457d-4fad-b4f7-9af30b206c71 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:43.590973 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c30bf9-457d-4fad-b4f7-9af30b206c71 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:43.593098 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c30bf9-457d-4fad-b4f7-9af30b206c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:43.616443 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-c8c30bf9-457d-4fad-b4f7-9af30b206c71 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:43.618073 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-c8c30bf9-457d-4fad-b4f7-9af30b206c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:43.635082 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c8b6c-dd4c-4308-b365-b5f1cd80c98f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:43.637625 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c8b6c-dd4c-4308-b365-b5f1cd80c98f None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:43.711506 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 183/357] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:43.712456 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c30bf9-457d-4fad-b4f7-9af30b206c71 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:43.723554 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:43.772287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 175/358] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:43.774082 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c8b6c-dd4c-4308-b365-b5f1cd80c98f None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:43.845054 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c30bf9-457d-4fad-b4f7-9af30b206c71 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:43.852910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:43.884017 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdb12b-21d3-4986-a2b8-d574efc8d9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:43.884663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdb12b-21d3-4986-a2b8-d574efc8d9d6 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:43.884882 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdb12b-21d3-4986-a2b8-d574efc8d9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:43.885133 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdb12b-21d3-4986-a2b8-d574efc8d9d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:43.885898 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdb12b-21d3-4986-a2b8-d574efc8d9d6 None admin] RBAC: Adding query filter params (group.id=3487e9172588429c83a62be3c43ce767, role.id=ab06ca80774d48a191fece38e3f335ad, scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:43.886199 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdb12b-21d3-4986-a2b8-d574efc8d9d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:43.888501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdb12b-21d3-4986-a2b8-d574efc8d9d6 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:43.895034 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 184/359] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Aug 17 14:46:43 2022] GET /identity/v3/role_assignments?group.id=3487e9172588429c83a62be3c43ce767&scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2&role.id=ab06ca80774d48a191fece38e3f335ad => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:43.895793 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdb12b-21d3-4986-a2b8-d574efc8d9d6 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:43.908072 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c8b6c-dd4c-4308-b365-b5f1cd80c98f None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:43.963956 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad1c7c-6887-457d-ada3-641477360bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:43.964587 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1c7c-6887-457d-ada3-641477360bf6 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:43.965572 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1c7c-6887-457d-ada3-641477360bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:43.966117 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1c7c-6887-457d-ada3-641477360bf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:44.018402 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:44.019047 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdb12b-21d3-4986-a2b8-d574efc8d9d6 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:44.058115 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad1c7c-6887-457d-ada3-641477360bf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:44.058338 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8096db0-8a81-4e78-9865-ebd5bcf12f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:44.059392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8096db0-8a81-4e78-9865-ebd5bcf12f3a None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:44.059679 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8096db0-8a81-4e78-9865-ebd5bcf12f3a None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:44.060051 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8096db0-8a81-4e78-9865-ebd5bcf12f3a None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:44.060549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad1c7c-6887-457d-ada3-641477360bf6 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:44.061356 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8096db0-8a81-4e78-9865-ebd5bcf12f3a None admin] RBAC: Authorizing `identity:get_project(project_id=a7643b24b47f42eab63dd25e22c5cdb2)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:44.062865 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8096db0-8a81-4e78-9865-ebd5bcf12f3a None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:44.064938 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 185/360] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:43 2022] GET /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:44.065994 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd55cc-77f9-40fd-9900-a9d3eef71253 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:44.066279 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd55cc-77f9-40fd-9900-a9d3eef71253 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:44.066550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd55cc-77f9-40fd-9900-a9d3eef71253 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:44.067890 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 186/361] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:44.073681 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd55cc-77f9-40fd-9900-a9d3eef71253 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:44.119697 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:44.207121 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 176/362] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:44.207904 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd55cc-77f9-40fd-9900-a9d3eef71253 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:44.208386 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f53fc-74b3-4e5a-bce8-ebf4cb2f1628 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:44.208670 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f53fc-74b3-4e5a-bce8-ebf4cb2f1628 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:44.208942 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f53fc-74b3-4e5a-bce8-ebf4cb2f1628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:44.230090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-910f53fc-74b3-4e5a-bce8-ebf4cb2f1628 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:44.231959 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-910f53fc-74b3-4e5a-bce8-ebf4cb2f1628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:44.249337 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8071a-e805-41d1-95bb-728400e51897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:44.250017 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8071a-e805-41d1-95bb-728400e51897 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:44.250294 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8071a-e805-41d1-95bb-728400e51897 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:44.250564 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8071a-e805-41d1-95bb-728400e51897 None admin] PATH_INFO: `/v3/groups/3487e9172588429c83a62be3c43ce767` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:44.251684 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8071a-e805-41d1-95bb-728400e51897 None admin] RBAC: Authorizing `identity:get_group(group_id=3487e9172588429c83a62be3c43ce767)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:44.253296 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8071a-e805-41d1-95bb-728400e51897 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:44.255048 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 187/363] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 17 14:46:44 2022] GET /identity/v3/groups/3487e9172588429c83a62be3c43ce767 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:44.255819 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8071a-e805-41d1-95bb-728400e51897 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:44.323865 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:44.331134 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 177/364] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:44.332113 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f53fc-74b3-4e5a-bce8-ebf4cb2f1628 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:44.414758 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8071a-e805-41d1-95bb-728400e51897 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:44.425297 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:44.473555 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f53fc-74b3-4e5a-bce8-ebf4cb2f1628 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:44.475631 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eeb8dc-e347-4b5d-b3c8-13cef2cac4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:44.477300 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeb8dc-e347-4b5d-b3c8-13cef2cac4c1 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:44.477588 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeb8dc-e347-4b5d-b3c8-13cef2cac4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:44.477908 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeb8dc-e347-4b5d-b3c8-13cef2cac4c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:44.494719 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eeb8dc-e347-4b5d-b3c8-13cef2cac4c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:44.503816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-a7eeb8dc-e347-4b5d-b3c8-13cef2cac4c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:44.503816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:44.503816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:44.503816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:44.503816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:44.503816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:44.503816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:44.503816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:44.503816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:44.503816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:44.503816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:44.503816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:44.503816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:44.503816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:44.503816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:44.503816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:44.504777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:44.504777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:44.504777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:44.504777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:44.504777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:44.504777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:44.504777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:44.504777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:44.504777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:44.504777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:44.504777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:44.504777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:44.504777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:44.504777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:44.504777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:44.504777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:44.505583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:44.505583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:44.505583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:44.505583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:44.505583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:44.505583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:44.505583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:44.505583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:44.505583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:44.505583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:44.505583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:44.505583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:46:44.506225 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 188/365] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:46:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:44.506860 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eeb8dc-e347-4b5d-b3c8-13cef2cac4c1 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:44.529884 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127a9b1-8fc1-4fe3-83d8-f31af7e0e720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:44.530527 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127a9b1-8fc1-4fe3-83d8-f31af7e0e720 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:44.530801 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127a9b1-8fc1-4fe3-83d8-f31af7e0e720 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:44.531074 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127a9b1-8fc1-4fe3-83d8-f31af7e0e720 None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:44.533843 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127a9b1-8fc1-4fe3-83d8-f31af7e0e720 None admin] RBAC: Authorizing `identity:get_project(project_id=721977c9f4e7432d96ddc227894864f0)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:44.537963 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127a9b1-8fc1-4fe3-83d8-f31af7e0e720 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:44.539939 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 178/366] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:44 2022] GET /identity/v3/projects/721977c9f4e7432d96ddc227894864f0 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:44.540717 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127a9b1-8fc1-4fe3-83d8-f31af7e0e720 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:44.629218 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:44.653849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eeb8dc-e347-4b5d-b3c8-13cef2cac4c1 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:44.670886 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127a9b1-8fc1-4fe3-83d8-f31af7e0e720 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:44.696856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37e521-4046-4b9a-bb51-ebc71e6e6686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:44.700776 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37e521-4046-4b9a-bb51-ebc71e6e6686 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:44.701432 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37e521-4046-4b9a-bb51-ebc71e6e6686 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:44.701952 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37e521-4046-4b9a-bb51-ebc71e6e6686 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:44.703007 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37e521-4046-4b9a-bb51-ebc71e6e6686 None admin] RBAC: Adding query filter params (group.id=3487e9172588429c83a62be3c43ce767, role.id=df9fac15c20d418187fbaf38acafd61f, scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:44.703520 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37e521-4046-4b9a-bb51-ebc71e6e6686 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:44.705283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37e521-4046-4b9a-bb51-ebc71e6e6686 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:44.712463 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 189/367] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Aug 17 14:46:44 2022] GET /identity/v3/role_assignments?group.id=3487e9172588429c83a62be3c43ce767&scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2&role.id=df9fac15c20d418187fbaf38acafd61f => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:44.713291 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37e521-4046-4b9a-bb51-ebc71e6e6686 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:44.716704 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cf7c5-7c99-4986-8509-b4c62773dc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:44.717998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cf7c5-7c99-4986-8509-b4c62773dc5a None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:44.719340 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cf7c5-7c99-4986-8509-b4c62773dc5a None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:44.719340 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cf7c5-7c99-4986-8509-b4c62773dc5a None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:44.720180 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cf7c5-7c99-4986-8509-b4c62773dc5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:44.720559 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cf7c5-7c99-4986-8509-b4c62773dc5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:44.722104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cf7c5-7c99-4986-8509-b4c62773dc5a None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:44.734959 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 179/368] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:46:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:44.745126 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cf7c5-7c99-4986-8509-b4c62773dc5a None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:44.766163 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:44.851019 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37e521-4046-4b9a-bb51-ebc71e6e6686 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:44.878549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cf7c5-7c99-4986-8509-b4c62773dc5a None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:44.891484 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab071f-85e7-4ecd-bc9d-6e4299f64139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:44.892702 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab071f-85e7-4ecd-bc9d-6e4299f64139 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:44.893149 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab071f-85e7-4ecd-bc9d-6e4299f64139 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:44.893554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab071f-85e7-4ecd-bc9d-6e4299f64139 None admin] PATH_INFO: `/v3/groups/3487e9172588429c83a62be3c43ce767` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:44.895057 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab071f-85e7-4ecd-bc9d-6e4299f64139 None admin] RBAC: Authorizing `identity:get_group(group_id=3487e9172588429c83a62be3c43ce767)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:44.896797 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab071f-85e7-4ecd-bc9d-6e4299f64139 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:44.899128 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 190/369] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 17 14:46:44 2022] GET /identity/v3/groups/3487e9172588429c83a62be3c43ce767 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:44.900227 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab071f-85e7-4ecd-bc9d-6e4299f64139 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:44.916544 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:44.925089 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb1ff7-caac-4edd-86b2-1d4552423092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:44.925836 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb1ff7-caac-4edd-86b2-1d4552423092 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:44.926237 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb1ff7-caac-4edd-86b2-1d4552423092 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:44.926595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb1ff7-caac-4edd-86b2-1d4552423092 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:45.016550 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb1ff7-caac-4edd-86b2-1d4552423092 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:45.018936 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb1ff7-caac-4edd-86b2-1d4552423092 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:45.025061 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:45.030098 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab071f-85e7-4ecd-bc9d-6e4299f64139 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:45.090680 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e059fb-e379-4bc9-9d26-826d313b5521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:45.091516 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e059fb-e379-4bc9-9d26-826d313b5521 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:45.091799 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e059fb-e379-4bc9-9d26-826d313b5521 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:45.092072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e059fb-e379-4bc9-9d26-826d313b5521 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:45.106474 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e059fb-e379-4bc9-9d26-826d313b5521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:45.113705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-d3e059fb-e379-4bc9-9d26-826d313b5521 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:46:45.113705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:45.113705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:45.113705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:45.113705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:45.113705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:45.113705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:45.113705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:45.113705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:45.113705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:45.113705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:45.113705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:45.113705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:45.113705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:45.113705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:45.113705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:45.114637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:45.114637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:45.114637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:45.114637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:45.114637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:45.114637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:45.114637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:45.114637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:45.114637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:45.114637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:45.114637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:45.114637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:45.114637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:45.114637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:45.114637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:45.114637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:45.115413 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:45.115413 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:45.115413 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:45.115413 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:45.115413 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:45.115413 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:45.115413 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:45.115413 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:45.115413 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:45.115413 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:45.115413 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:46:45.115413 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:46:45.116691 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 191/370] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 17 14:46:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:45.117206 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e059fb-e379-4bc9-9d26-826d313b5521 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:45.165960 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 180/371] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:45.167566 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb1ff7-caac-4edd-86b2-1d4552423092 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:45.210209 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:45.271704 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e059fb-e379-4bc9-9d26-826d313b5521 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:45.295631 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb1ff7-caac-4edd-86b2-1d4552423092 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:45.320345 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d84758-8fd7-4a6f-acf1-860a40a461b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:45.321875 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d84758-8fd7-4a6f-acf1-860a40a461b4 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:45.322322 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d84758-8fd7-4a6f-acf1-860a40a461b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:45.322739 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d84758-8fd7-4a6f-acf1-860a40a461b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:45.324506 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d84758-8fd7-4a6f-acf1-860a40a461b4 None admin] RBAC: Adding query filter params (group.id=3487e9172588429c83a62be3c43ce767, role.id=ab06ca80774d48a191fece38e3f335ad, scope.project.id=721977c9f4e7432d96ddc227894864f0) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:45.325083 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d84758-8fd7-4a6f-acf1-860a40a461b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:45.327592 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d84758-8fd7-4a6f-acf1-860a40a461b4 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:45.334559 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 192/372] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Aug 17 14:46:45 2022] GET /identity/v3/role_assignments?group.id=3487e9172588429c83a62be3c43ce767&scope.project.id=721977c9f4e7432d96ddc227894864f0&role.id=ab06ca80774d48a191fece38e3f335ad => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:45.335218 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf7204-69f4-439f-b8bf-50594c9d624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:45.335709 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d84758-8fd7-4a6f-acf1-860a40a461b4 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:45.335817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf7204-69f4-439f-b8bf-50594c9d624e None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:45.336084 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf7204-69f4-439f-b8bf-50594c9d624e None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:45.336381 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf7204-69f4-439f-b8bf-50594c9d624e None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:45.337388 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf7204-69f4-439f-b8bf-50594c9d624e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:45.337823 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf7204-69f4-439f-b8bf-50594c9d624e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:45.339340 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf7204-69f4-439f-b8bf-50594c9d624e None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:45.353439 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 181/373] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:45.362859 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf7204-69f4-439f-b8bf-50594c9d624e None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:45.372916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:45.470269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d84758-8fd7-4a6f-acf1-860a40a461b4 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:45.523519 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:45.523693 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b997d0f-e3d1-4c01-8b7c-640b977f5fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:45.524557 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b997d0f-e3d1-4c01-8b7c-640b977f5fe2 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:45.524663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b997d0f-e3d1-4c01-8b7c-640b977f5fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:45.524864 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b997d0f-e3d1-4c01-8b7c-640b977f5fe2 None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:45.529757 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b997d0f-e3d1-4c01-8b7c-640b977f5fe2 None admin] RBAC: Authorizing `identity:get_project(project_id=721977c9f4e7432d96ddc227894864f0)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:45.531209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b997d0f-e3d1-4c01-8b7c-640b977f5fe2 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:45.532917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 193/374] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:45 2022] GET /identity/v3/projects/721977c9f4e7432d96ddc227894864f0 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:45.540477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b997d0f-e3d1-4c01-8b7c-640b977f5fe2 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:45.547506 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf7204-69f4-439f-b8bf-50594c9d624e None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:45.608331 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a5e5d-db15-4023-8e77-6d184ff7f1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:45.608972 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a5e5d-db15-4023-8e77-6d184ff7f1a5 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:45.609251 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a5e5d-db15-4023-8e77-6d184ff7f1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:45.609525 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a5e5d-db15-4023-8e77-6d184ff7f1a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:45.724422 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a5e5d-db15-4023-8e77-6d184ff7f1a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:45.726191 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a5e5d-db15-4023-8e77-6d184ff7f1a5 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:45.758014 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:45.776919 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b997d0f-e3d1-4c01-8b7c-640b977f5fe2 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:45.852026 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc0c7e-a75d-45a6-827e-a6d440dc392b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:45.852703 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc0c7e-a75d-45a6-827e-a6d440dc392b None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:45.852982 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc0c7e-a75d-45a6-827e-a6d440dc392b None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:45.853250 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc0c7e-a75d-45a6-827e-a6d440dc392b None admin] PATH_INFO: `/v3/groups/3487e9172588429c83a62be3c43ce767` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:45.857186 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc0c7e-a75d-45a6-827e-a6d440dc392b None admin] RBAC: Authorizing `identity:get_group(group_id=3487e9172588429c83a62be3c43ce767)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:45.858612 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc0c7e-a75d-45a6-827e-a6d440dc392b None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:45.860399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 194/375] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 17 14:46:45 2022] GET /identity/v3/groups/3487e9172588429c83a62be3c43ce767 => generated 226 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:45.867526 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc0c7e-a75d-45a6-827e-a6d440dc392b None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:45.924496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:45.942163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 182/376] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:45.948198 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a5e5d-db15-4023-8e77-6d184ff7f1a5 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:46.059936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc0c7e-a75d-45a6-827e-a6d440dc392b None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:46.122379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a5e5d-db15-4023-8e77-6d184ff7f1a5 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:46.126299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff4e2a-514d-409a-852b-aca5b71b5ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:46.126906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff4e2a-514d-409a-852b-aca5b71b5ff2 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:46.127181 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff4e2a-514d-409a-852b-aca5b71b5ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:46.127448 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff4e2a-514d-409a-852b-aca5b71b5ff2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:46.128179 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff4e2a-514d-409a-852b-aca5b71b5ff2 None admin] RBAC: Adding query filter params (group.id=3487e9172588429c83a62be3c43ce767, role.id=df9fac15c20d418187fbaf38acafd61f, scope.project.id=721977c9f4e7432d96ddc227894864f0) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:46.128487 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff4e2a-514d-409a-852b-aca5b71b5ff2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:46.129953 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff4e2a-514d-409a-852b-aca5b71b5ff2 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:46.143183 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 195/377] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Aug 17 14:46:45 2022] GET /identity/v3/role_assignments?group.id=3487e9172588429c83a62be3c43ce767&scope.project.id=721977c9f4e7432d96ddc227894864f0&role.id=df9fac15c20d418187fbaf38acafd61f => generated 260 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:46.172452 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b5f95-d4f4-437b-980b-358037187ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:46.173433 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b5f95-d4f4-437b-980b-358037187ac5 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:46.173963 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b5f95-d4f4-437b-980b-358037187ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:46.174391 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b5f95-d4f4-437b-980b-358037187ac5 None admin] PATH_INFO: `/v3/projects/09a5e42d9b6e4e598b40571f10c289e0` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:46.176089 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b5f95-d4f4-437b-980b-358037187ac5 None admin] RBAC: Authorizing `identity:get_project(project_id=09a5e42d9b6e4e598b40571f10c289e0)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:46.178161 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b5f95-d4f4-437b-980b-358037187ac5 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:46.180221 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 183/378] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:45 2022] GET /identity/v3/projects/09a5e42d9b6e4e598b40571f10c289e0 => generated 344 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:46.187123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff4e2a-514d-409a-852b-aca5b71b5ff2 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:46.216858 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:46.347301 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff4e2a-514d-409a-852b-aca5b71b5ff2 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:46.414725 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf58e1-56d5-41e3-8d57-955e1761d6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:46.415389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf58e1-56d5-41e3-8d57-955e1761d6a0 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:46.415669 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf58e1-56d5-41e3-8d57-955e1761d6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:46.415944 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf58e1-56d5-41e3-8d57-955e1761d6a0 None admin] PATH_INFO: `/v3/groups/ea48d097f84644109f7aa1a1d6e42118` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:46.434218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf58e1-56d5-41e3-8d57-955e1761d6a0 None admin] RBAC: Authorizing `identity:get_group(group_id=ea48d097f84644109f7aa1a1d6e42118)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:46.435771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf58e1-56d5-41e3-8d57-955e1761d6a0 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:46.437824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 196/379] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 17 14:46:46 2022] GET /identity/v3/groups/ea48d097f84644109f7aa1a1d6e42118 => generated 229 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:46.444633 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b5f95-d4f4-437b-980b-358037187ac5 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:46.515283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:46.557054 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b5f95-d4f4-437b-980b-358037187ac5 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:46.608361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee8d7c-c7a3-4d7b-8e26-75c5e12be5cd None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:46.608658 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee8d7c-c7a3-4d7b-8e26-75c5e12be5cd None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:46.608821 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee8d7c-c7a3-4d7b-8e26-75c5e12be5cd None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:46.610460 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 197/380] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:46.611046 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef956bd-2d44-4e1f-844e-a47c3b814926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:46.611653 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef956bd-2d44-4e1f-844e-a47c3b814926 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:46.611985 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef956bd-2d44-4e1f-844e-a47c3b814926 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:46.612256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef956bd-2d44-4e1f-844e-a47c3b814926 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:46.612996 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef956bd-2d44-4e1f-844e-a47c3b814926 None admin] RBAC: Adding query filter params (group.id=ea48d097f84644109f7aa1a1d6e42118, role.id=a307f157f2a445c7af8bd4fd41aa1c4b, scope.project.id=09a5e42d9b6e4e598b40571f10c289e0) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:46.613301 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef956bd-2d44-4e1f-844e-a47c3b814926 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:46.614810 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef956bd-2d44-4e1f-844e-a47c3b814926 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:46.617199 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb7d4c-1e7d-4eae-8633-188788a5c6ba None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:46.617531 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb7d4c-1e7d-4eae-8633-188788a5c6ba None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:46.617827 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb7d4c-1e7d-4eae-8633-188788a5c6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:46.638321 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 184/381] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Aug 17 14:46:46 2022] GET /identity/v3/role_assignments?group.id=ea48d097f84644109f7aa1a1d6e42118&scope.project.id=09a5e42d9b6e4e598b40571f10c289e0&role.id=a307f157f2a445c7af8bd4fd41aa1c4b => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:46.648824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-f1bb7d4c-1e7d-4eae-8633-188788a5c6ba None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:46.650113 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-f1bb7d4c-1e7d-4eae-8633-188788a5c6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:46.762267 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 198/382] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:46:47.290177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef956bd-2d44-4e1f-844e-a47c3b814926 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:47.410305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef956bd-2d44-4e1f-844e-a47c3b814926 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:47.438821 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:47.450400 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c67ef-5338-496a-993f-a78856e7649c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:47.451026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c67ef-5338-496a-993f-a78856e7649c None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:47.451300 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c67ef-5338-496a-993f-a78856e7649c None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:47.451568 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c67ef-5338-496a-993f-a78856e7649c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:47.470597 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c67ef-5338-496a-993f-a78856e7649c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:47.475813 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-166c67ef-5338-496a-993f-a78856e7649c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:47.475813 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:47.475813 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:47.475813 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:47.475813 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:47.475813 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:47.475813 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:47.475813 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:47.475813 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:47.475813 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:47.475813 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:47.475813 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:47.475813 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:47.475813 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:47.475813 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:47.475813 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:47.476745 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:47.476745 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:47.476745 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:47.476745 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:47.476745 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:47.476745 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:47.476745 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:47.476745 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:47.476745 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:47.476745 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:47.476745 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:47.476745 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:47.476745 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:47.476745 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:47.476745 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:47.476745 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:47.477547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:47.477547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:47.477547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:47.477547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:47.477547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:47.477547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:47.477547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:47.477547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:47.477547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:47.477547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:47.477547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:47.477547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:47.477547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 185/383] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:47.485183 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb7d4c-1e7d-4eae-8633-188788a5c6ba None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:47.510787 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:47.619746 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb7d4c-1e7d-4eae-8633-188788a5c6ba None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:47.665472 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5fb51-8459-44f1-a2b8-2823f4955720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:47.666114 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5fb51-8459-44f1-a2b8-2823f4955720 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:47.666389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5fb51-8459-44f1-a2b8-2823f4955720 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:47.666659 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5fb51-8459-44f1-a2b8-2823f4955720 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:47.667328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e5fb51-8459-44f1-a2b8-2823f4955720 None admin] RBAC: Adding query filter params (name=member) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:47.668157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e5fb51-8459-44f1-a2b8-2823f4955720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:47.669552 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e5fb51-8459-44f1-a2b8-2823f4955720 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:47.679247 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 199/384] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:47.685575 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c67ef-5338-496a-993f-a78856e7649c None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:47.824302 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c67ef-5338-496a-993f-a78856e7649c None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:47.837340 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33221e9-47ff-47dd-a0c2-e3d115f2a9a5 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:47.837638 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33221e9-47ff-47dd-a0c2-e3d115f2a9a5 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:47.838034 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33221e9-47ff-47dd-a0c2-e3d115f2a9a5 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:47.840233 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 200/385] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:47.846953 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1e99e-0d16-4c5c-8cf7-b1b44d14b57a None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:47.847238 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1e99e-0d16-4c5c-8cf7-b1b44d14b57a None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:47.847508 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1e99e-0d16-4c5c-8cf7-b1b44d14b57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:47.865984 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dceb949-cbdb-48fc-988e-298822ac432c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:47.866623 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dceb949-cbdb-48fc-988e-298822ac432c None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:47.866902 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dceb949-cbdb-48fc-988e-298822ac432c None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:47.867173 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dceb949-cbdb-48fc-988e-298822ac432c None admin] PATH_INFO: `/v3/groups/3487e9172588429c83a62be3c43ce767` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:47.867631 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-1bb1e99e-0d16-4c5c-8cf7-b1b44d14b57a None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:47.868328 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dceb949-cbdb-48fc-988e-298822ac432c None admin] RBAC: Authorizing `identity:get_group(group_id=3487e9172588429c83a62be3c43ce767)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:47.868826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-1bb1e99e-0d16-4c5c-8cf7-b1b44d14b57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:47.869783 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dceb949-cbdb-48fc-988e-298822ac432c None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:47.872514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 186/386] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 17 14:46:47 2022] GET /identity/v3/groups/3487e9172588429c83a62be3c43ce767 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:47.877975 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dceb949-cbdb-48fc-988e-298822ac432c None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:47.941659 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:47.966009 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 201/387] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:46:48.004616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dceb949-cbdb-48fc-988e-298822ac432c None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:48.043730 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc039e5-8f39-42c8-bc62-19037d41a7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:48.044720 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc039e5-8f39-42c8-bc62-19037d41a7da None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:48.045005 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc039e5-8f39-42c8-bc62-19037d41a7da None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:48.045308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc039e5-8f39-42c8-bc62-19037d41a7da None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:48.046529 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc039e5-8f39-42c8-bc62-19037d41a7da None admin] RBAC: Authorizing `identity:get_project(project_id=a7643b24b47f42eab63dd25e22c5cdb2)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:48.047954 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc039e5-8f39-42c8-bc62-19037d41a7da None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:48.049888 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 187/388] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:47 2022] GET /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:48.055756 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1e99e-0d16-4c5c-8cf7-b1b44d14b57a None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:48.098197 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:48.166308 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1e99e-0d16-4c5c-8cf7-b1b44d14b57a None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:48.204044 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246912ff-629d-4a9a-a69f-72ca37ad5be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:48.204711 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246912ff-629d-4a9a-a69f-72ca37ad5be6 None admin] REQUEST_METHOD: `PUT` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:48.205128 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246912ff-629d-4a9a-a69f-72ca37ad5be6 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:48.205378 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246912ff-629d-4a9a-a69f-72ca37ad5be6 None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2/groups/3487e9172588429c83a62be3c43ce767/roles/ab06ca80774d48a191fece38e3f335ad` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:48.207352 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246912ff-629d-4a9a-a69f-72ca37ad5be6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7643b24b47f42eab63dd25e22c5cdb2, group_id=3487e9172588429c83a62be3c43ce767, role_id=ab06ca80774d48a191fece38e3f335ad)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:48.208778 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246912ff-629d-4a9a-a69f-72ca37ad5be6 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:48.223234 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 202/389] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Aug 17 14:46:48 2022] PUT /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2/groups/3487e9172588429c83a62be3c43ce767/roles/ab06ca80774d48a191fece38e3f335ad => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:46:48.362357 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc039e5-8f39-42c8-bc62-19037d41a7da None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:48.487958 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc039e5-8f39-42c8-bc62-19037d41a7da None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:48.513636 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:48.534618 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d4a6b-8f48-47ea-b6b4-1fb39f4f090b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:48.535706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d4a6b-8f48-47ea-b6b4-1fb39f4f090b None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:48.536182 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d4a6b-8f48-47ea-b6b4-1fb39f4f090b None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:48.536647 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d4a6b-8f48-47ea-b6b4-1fb39f4f090b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:48.553849 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d4a6b-8f48-47ea-b6b4-1fb39f4f090b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:48.559917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-545d4a6b-8f48-47ea-b6b4-1fb39f4f090b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:48.559917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:48.559917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:48.559917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:48.559917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:48.559917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:48.559917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:48.559917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:48.559917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:48.559917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:48.559917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:48.559917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:48.559917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:48.559917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:48.559917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:48.559917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:48.560873 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:48.560873 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:48.560873 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:48.560873 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:48.560873 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:48.560873 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:48.560873 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:48.560873 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:48.560873 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:48.560873 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:48.560873 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:48.560873 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:48.560873 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:48.560873 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:48.560873 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:48.560873 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:48.561657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:48.561657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:48.561657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:48.561657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:48.561657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:48.561657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:48.561657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:48.561657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:48.561657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:48.561657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:48.561657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:48.561657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:48.563844 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 188/390] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:46:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:48.573401 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246912ff-629d-4a9a-a69f-72ca37ad5be6 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:48.666206 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:48.698586 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246912ff-629d-4a9a-a69f-72ca37ad5be6 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:48.737792 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee894fd-360c-41f5-9b63-a4d850e34da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:48.738402 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee894fd-360c-41f5-9b63-a4d850e34da8 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:48.738679 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee894fd-360c-41f5-9b63-a4d850e34da8 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:48.738946 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee894fd-360c-41f5-9b63-a4d850e34da8 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:48.739615 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee894fd-360c-41f5-9b63-a4d850e34da8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:48.739912 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee894fd-360c-41f5-9b63-a4d850e34da8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:48.741373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee894fd-360c-41f5-9b63-a4d850e34da8 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:48.751280 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 203/391] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:46:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:48.761489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d4a6b-8f48-47ea-b6b4-1fb39f4f090b None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:48.787240 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775540d-0212-44fd-9577-5c9a629b9b24 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:48.788244 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775540d-0212-44fd-9577-5c9a629b9b24 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:48.788619 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775540d-0212-44fd-9577-5c9a629b9b24 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:48.790835 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 204/392] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:46:48.797093 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6922664-845b-46f7-8aa7-5971a21be410 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:48.797474 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6922664-845b-46f7-8aa7-5971a21be410 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:48.797865 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6922664-845b-46f7-8aa7-5971a21be410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:48.820420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-d6922664-845b-46f7-8aa7-5971a21be410 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:48.822283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-d6922664-845b-46f7-8aa7-5971a21be410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:48.906644 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 205/393] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:46:48.963414 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d4a6b-8f48-47ea-b6b4-1fb39f4f090b None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:49.014204 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc01ef-4b98-40e5-b7ab-cd58b77164bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:49.014858 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc01ef-4b98-40e5-b7ab-cd58b77164bc None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:49.015136 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc01ef-4b98-40e5-b7ab-cd58b77164bc None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:49.015408 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc01ef-4b98-40e5-b7ab-cd58b77164bc None admin] PATH_INFO: `/v3/groups/3487e9172588429c83a62be3c43ce767` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:49.016641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc01ef-4b98-40e5-b7ab-cd58b77164bc None admin] RBAC: Authorizing `identity:get_group(group_id=3487e9172588429c83a62be3c43ce767)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:49.018162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc01ef-4b98-40e5-b7ab-cd58b77164bc None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:49.020167 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 189/394] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 17 14:46:48 2022] GET /identity/v3/groups/3487e9172588429c83a62be3c43ce767 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:49.025530 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6922664-845b-46f7-8aa7-5971a21be410 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:49.091458 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:49.151775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6922664-845b-46f7-8aa7-5971a21be410 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:49.188338 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc24df6-234e-4c6c-aa35-a0b4a35501ed None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:49.188646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc24df6-234e-4c6c-aa35-a0b4a35501ed None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:49.188902 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc24df6-234e-4c6c-aa35-a0b4a35501ed None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:49.191742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 190/395] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:49.197899 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b94fae-a54f-47ad-a10b-f91753a3d3c5 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:49.198180 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b94fae-a54f-47ad-a10b-f91753a3d3c5 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:49.198457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b94fae-a54f-47ad-a10b-f91753a3d3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:49.207198 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe35300-3e5f-45fe-9d2c-1ece3a52fa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:49.208093 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe35300-3e5f-45fe-9d2c-1ece3a52fa3d None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:49.208541 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe35300-3e5f-45fe-9d2c-1ece3a52fa3d None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:49.209353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe35300-3e5f-45fe-9d2c-1ece3a52fa3d None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:49.216637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe35300-3e5f-45fe-9d2c-1ece3a52fa3d None admin] RBAC: Authorizing `identity:get_project(project_id=a7643b24b47f42eab63dd25e22c5cdb2)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:49.219293 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe35300-3e5f-45fe-9d2c-1ece3a52fa3d None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:49.221914 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 206/396] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:49 2022] GET /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:49.227952 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe35300-3e5f-45fe-9d2c-1ece3a52fa3d None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:49.238664 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-97b94fae-a54f-47ad-a10b-f91753a3d3c5 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:49.239943 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-97b94fae-a54f-47ad-a10b-f91753a3d3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:49.296752 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:49.344997 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 191/397] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:46:49.365105 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b94fae-a54f-47ad-a10b-f91753a3d3c5 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:49.467765 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe35300-3e5f-45fe-9d2c-1ece3a52fa3d None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:49.487667 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b94fae-a54f-47ad-a10b-f91753a3d3c5 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:49.523122 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8ef5e-0a99-453a-9945-b320866dd3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:49.523898 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8ef5e-0a99-453a-9945-b320866dd3a4 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:49.524267 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8ef5e-0a99-453a-9945-b320866dd3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:49.524649 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8ef5e-0a99-453a-9945-b320866dd3a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:49.536289 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8ef5e-0a99-453a-9945-b320866dd3a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:49.541706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-1ae8ef5e-0a99-453a-9945-b320866dd3a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:49.541706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:49.541706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:49.541706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:49.541706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:49.541706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:49.541706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:49.541706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:49.541706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:49.541706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:49.541706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:49.541706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:49.541706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:49.541706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:49.541706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:49.541706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:49.543390 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:49.543390 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:49.543390 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:49.543390 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:49.543390 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:49.543390 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:49.543390 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:49.543390 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:49.543390 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:49.543390 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:49.543390 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:49.543390 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:49.543390 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:49.543390 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:49.543390 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:49.543390 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:49.544164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:49.544164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:49.544164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:49.544164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:49.544164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:49.544164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:49.544164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:49.544164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:49.544164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:49.544164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:49.544164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:49.544164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:49.545141 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 192/398] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:46:49.550518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8ef5e-0a99-453a-9945-b320866dd3a4 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:49.582087 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:49.606224 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:49.627217 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26b692-2a6d-44fd-9dfd-42e2978379df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:49.627900 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26b692-2a6d-44fd-9dfd-42e2978379df None admin] REQUEST_METHOD: `PUT` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:49.628176 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26b692-2a6d-44fd-9dfd-42e2978379df None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:49.628448 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26b692-2a6d-44fd-9dfd-42e2978379df None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2/groups/3487e9172588429c83a62be3c43ce767/roles/df9fac15c20d418187fbaf38acafd61f` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:49.642701 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26b692-2a6d-44fd-9dfd-42e2978379df None admin] RBAC: Authorizing `identity:create_grant(project_id=a7643b24b47f42eab63dd25e22c5cdb2, group_id=3487e9172588429c83a62be3c43ce767, role_id=df9fac15c20d418187fbaf38acafd61f)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:49.644192 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26b692-2a6d-44fd-9dfd-42e2978379df None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:49.673538 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8ef5e-0a99-453a-9945-b320866dd3a4 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:49.684400 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 207/399] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Aug 17 14:46:49 2022] PUT /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2/groups/3487e9172588429c83a62be3c43ce767/roles/df9fac15c20d418187fbaf38acafd61f => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:46:49.712721 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206546d-7f01-437c-8634-9058dbe888b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:49.713423 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206546d-7f01-437c-8634-9058dbe888b5 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:49.713703 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206546d-7f01-437c-8634-9058dbe888b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:49.714007 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206546d-7f01-437c-8634-9058dbe888b5 None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:49.715320 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206546d-7f01-437c-8634-9058dbe888b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:49.715609 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26b692-2a6d-44fd-9dfd-42e2978379df None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:49.715919 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206546d-7f01-437c-8634-9058dbe888b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:49.717492 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206546d-7f01-437c-8634-9058dbe888b5 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:49.729033 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 193/400] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:49.736478 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206546d-7f01-437c-8634-9058dbe888b5 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:49.869906 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206546d-7f01-437c-8634-9058dbe888b5 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:49.881525 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:49.914960 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e53752-763a-4c58-9c9e-3e950489ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:49.916170 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e53752-763a-4c58-9c9e-3e950489ba84 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:49.916620 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e53752-763a-4c58-9c9e-3e950489ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:49.917073 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e53752-763a-4c58-9c9e-3e950489ba84 None admin] PATH_INFO: `/v3/groups/3487e9172588429c83a62be3c43ce767` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:49.919762 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e53752-763a-4c58-9c9e-3e950489ba84 None admin] RBAC: Authorizing `identity:get_group(group_id=3487e9172588429c83a62be3c43ce767)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:49.921661 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e53752-763a-4c58-9c9e-3e950489ba84 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:49.924749 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 194/401] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 17 14:46:49 2022] GET /identity/v3/groups/3487e9172588429c83a62be3c43ce767 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:49.926802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce857dd-00f6-4118-98ec-b77cd187808c None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:49.927510 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce857dd-00f6-4118-98ec-b77cd187808c None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:49.927954 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce857dd-00f6-4118-98ec-b77cd187808c None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:49.929283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26b692-2a6d-44fd-9dfd-42e2978379df None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:49.933866 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 195/402] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:49.934666 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce857dd-00f6-4118-98ec-b77cd187808c None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:49.972417 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ba9ff-c6ee-431d-9a28-d28eb8108c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:49.973459 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ba9ff-c6ee-431d-9a28-d28eb8108c8f None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:49.973961 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ba9ff-c6ee-431d-9a28-d28eb8108c8f None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:49.974439 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ba9ff-c6ee-431d-9a28-d28eb8108c8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:49.986492 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ba9ff-c6ee-431d-9a28-d28eb8108c8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:49.992790 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-4b0ba9ff-c6ee-431d-9a28-d28eb8108c8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:49.992790 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:49.992790 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:49.992790 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:49.992790 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:49.992790 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:49.992790 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:49.992790 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:49.992790 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:49.992790 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:49.992790 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:49.992790 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:49.992790 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:49.992790 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:49.992790 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:49.992790 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:49.993667 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:49.993667 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:49.993667 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:49.993667 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:49.993667 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:49.993667 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:49.993667 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:49.993667 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:49.993667 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:49.993667 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:49.993667 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:49.993667 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:49.993667 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:49.993667 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:49.993667 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:49.993667 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:49.994756 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:49.994756 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:49.994756 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:49.994756 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:49.994756 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:49.994756 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:49.994756 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:49.994756 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:49.994756 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:49.994756 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:49.994756 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:49.994756 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:46:49.998039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 208/403] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:46:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:49.999619 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246a10c-4a01-4320-8e33-49f85a6fc09d None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:50.000158 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246a10c-4a01-4320-8e33-49f85a6fc09d None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:50.000803 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246a10c-4a01-4320-8e33-49f85a6fc09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:50.020397 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-3246a10c-4a01-4320-8e33-49f85a6fc09d None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:50.022090 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-3246a10c-4a01-4320-8e33-49f85a6fc09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:50.047612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce857dd-00f6-4118-98ec-b77cd187808c None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:50.072947 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:50.084902 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5c9a6-216a-48ee-95f8-5fb8ef7658cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:50.085567 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5c9a6-216a-48ee-95f8-5fb8ef7658cd None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:50.085891 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5c9a6-216a-48ee-95f8-5fb8ef7658cd None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:50.086163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5c9a6-216a-48ee-95f8-5fb8ef7658cd None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:50.087838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5c9a6-216a-48ee-95f8-5fb8ef7658cd None admin] RBAC: Authorizing `identity:get_project(project_id=721977c9f4e7432d96ddc227894864f0)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:50.089326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5c9a6-216a-48ee-95f8-5fb8ef7658cd None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:50.092306 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 196/404] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:49 2022] GET /identity/v3/projects/721977c9f4e7432d96ddc227894864f0 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:50.093003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5c9a6-216a-48ee-95f8-5fb8ef7658cd None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:50.107623 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 209/405] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:50.108891 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246a10c-4a01-4320-8e33-49f85a6fc09d None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:50.137409 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:50.205164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5c9a6-216a-48ee-95f8-5fb8ef7658cd None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:50.242394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab23ed-9298-4201-a1a9-7f3fd2a3a25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:50.243064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab23ed-9298-4201-a1a9-7f3fd2a3a25c None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:50.243486 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab23ed-9298-4201-a1a9-7f3fd2a3a25c None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:50.243856 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab23ed-9298-4201-a1a9-7f3fd2a3a25c None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:50.244729 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab23ed-9298-4201-a1a9-7f3fd2a3a25c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:50.245598 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab23ed-9298-4201-a1a9-7f3fd2a3a25c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:50.247749 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab23ed-9298-4201-a1a9-7f3fd2a3a25c None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:50.256795 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 197/406] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:46:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:50.263018 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab23ed-9298-4201-a1a9-7f3fd2a3a25c None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:50.285077 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246a10c-4a01-4320-8e33-49f85a6fc09d None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:50.319902 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76496d2d-024a-4786-8566-eed9ff0752ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:50.320557 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76496d2d-024a-4786-8566-eed9ff0752ac None admin] REQUEST_METHOD: `PUT` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:50.320833 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76496d2d-024a-4786-8566-eed9ff0752ac None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:50.321102 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76496d2d-024a-4786-8566-eed9ff0752ac None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0/groups/3487e9172588429c83a62be3c43ce767/roles/ab06ca80774d48a191fece38e3f335ad` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:50.323264 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76496d2d-024a-4786-8566-eed9ff0752ac None admin] RBAC: Authorizing `identity:create_grant(project_id=721977c9f4e7432d96ddc227894864f0, group_id=3487e9172588429c83a62be3c43ce767, role_id=ab06ca80774d48a191fece38e3f335ad)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:50.325700 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76496d2d-024a-4786-8566-eed9ff0752ac None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:50.341555 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 210/407] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Aug 17 14:46:50 2022] PUT /identity/v3/projects/721977c9f4e7432d96ddc227894864f0/groups/3487e9172588429c83a62be3c43ce767/roles/ab06ca80774d48a191fece38e3f335ad => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:46:50.445774 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab23ed-9298-4201-a1a9-7f3fd2a3a25c None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:50.450283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:50.485442 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ae62e-a078-4538-b284-41d97e29b0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:50.486123 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ae62e-a078-4538-b284-41d97e29b0ae None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:50.486407 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ae62e-a078-4538-b284-41d97e29b0ae None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:50.486686 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ae62e-a078-4538-b284-41d97e29b0ae None admin] PATH_INFO: `/v3/groups/3487e9172588429c83a62be3c43ce767` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:50.487898 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ae62e-a078-4538-b284-41d97e29b0ae None admin] RBAC: Authorizing `identity:get_group(group_id=3487e9172588429c83a62be3c43ce767)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:50.489679 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ae62e-a078-4538-b284-41d97e29b0ae None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:50.492562 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 198/408] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 17 14:46:50 2022] GET /identity/v3/groups/3487e9172588429c83a62be3c43ce767 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:50.498070 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76496d2d-024a-4786-8566-eed9ff0752ac None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:50.571266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:50.590615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ae62e-a078-4538-b284-41d97e29b0ae None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:50.644365 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76496d2d-024a-4786-8566-eed9ff0752ac None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:50.682188 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c506d-0fed-4eac-8da0-c755784b4a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:50.683292 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c506d-0fed-4eac-8da0-c755784b4a2a None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:50.684489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c506d-0fed-4eac-8da0-c755784b4a2a None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:50.685058 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c506d-0fed-4eac-8da0-c755784b4a2a None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:50.686582 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c506d-0fed-4eac-8da0-c755784b4a2a None admin] RBAC: Authorizing `identity:get_project(project_id=721977c9f4e7432d96ddc227894864f0)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:50.688202 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c506d-0fed-4eac-8da0-c755784b4a2a None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:50.690600 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 211/409] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:50 2022] GET /identity/v3/projects/721977c9f4e7432d96ddc227894864f0 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:50.697761 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c506d-0fed-4eac-8da0-c755784b4a2a None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:50.705756 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ae62e-a078-4538-b284-41d97e29b0ae None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:50.779415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce80dd-477f-466d-800a-015f99a3a31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:50.779978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce80dd-477f-466d-800a-015f99a3a31f None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:50.780254 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce80dd-477f-466d-800a-015f99a3a31f None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:50.780531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce80dd-477f-466d-800a-015f99a3a31f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:50.799752 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce80dd-477f-466d-800a-015f99a3a31f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:50.811738 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-efce80dd-477f-466d-800a-015f99a3a31f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:46:50.811738 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:50.811738 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:50.811738 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:50.811738 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:50.811738 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:50.811738 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:50.811738 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:50.811738 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:50.811738 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:50.811738 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:50.811738 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:50.811738 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:50.811738 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:50.811738 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:50.811738 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:50.812924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:50.812924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:50.812924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:50.812924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:50.812924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:50.812924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:50.812924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:50.812924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:50.812924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:50.812924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:50.812924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:50.812924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:50.812924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:50.812924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:50.812924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:50.812924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:50.813918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:50.813918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:50.813918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:50.813918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:50.813918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:50.813918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:50.813918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:50.813918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:50.813918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:50.813918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:50.813918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:46:50.813918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:50.816063 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 199/410] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 17 14:46:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:46:50.823093 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce80dd-477f-466d-800a-015f99a3a31f None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:50.860904 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c506d-0fed-4eac-8da0-c755784b4a2a None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:50.874138 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:50.877181 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:50.964164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce80dd-477f-466d-800a-015f99a3a31f None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:50.970465 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebded5de-f339-44b5-b0be-0ab11d295871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:50.971147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebded5de-f339-44b5-b0be-0ab11d295871 None admin] REQUEST_METHOD: `PUT` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:50.971423 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebded5de-f339-44b5-b0be-0ab11d295871 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:50.971693 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebded5de-f339-44b5-b0be-0ab11d295871 None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0/groups/3487e9172588429c83a62be3c43ce767/roles/df9fac15c20d418187fbaf38acafd61f` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:50.979030 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebded5de-f339-44b5-b0be-0ab11d295871 None admin] RBAC: Authorizing `identity:create_grant(project_id=721977c9f4e7432d96ddc227894864f0, group_id=3487e9172588429c83a62be3c43ce767, role_id=df9fac15c20d418187fbaf38acafd61f)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:50.980862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebded5de-f339-44b5-b0be-0ab11d295871 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:51.003314 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e801ab0-046e-4ed2-b6b9-e595cd5b7505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:51.004180 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e801ab0-046e-4ed2-b6b9-e595cd5b7505 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:51.004601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e801ab0-046e-4ed2-b6b9-e595cd5b7505 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:51.005036 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e801ab0-046e-4ed2-b6b9-e595cd5b7505 None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:51.005886 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e801ab0-046e-4ed2-b6b9-e595cd5b7505 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:51.006646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e801ab0-046e-4ed2-b6b9-e595cd5b7505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:51.008334 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e801ab0-046e-4ed2-b6b9-e595cd5b7505 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:51.018108 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 200/411] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:51.020248 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 212/412] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Aug 17 14:46:50 2022] PUT /identity/v3/projects/721977c9f4e7432d96ddc227894864f0/groups/3487e9172588429c83a62be3c43ce767/roles/df9fac15c20d418187fbaf38acafd61f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:46:51.023527 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e801ab0-046e-4ed2-b6b9-e595cd5b7505 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:51.133601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:51.144646 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb75188-98fd-428a-84c9-bc95a4b9761c None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:51.145035 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb75188-98fd-428a-84c9-bc95a4b9761c None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:51.145380 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb75188-98fd-428a-84c9-bc95a4b9761c None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:51.147166 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 213/413] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:46:51.149309 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e801ab0-046e-4ed2-b6b9-e595cd5b7505 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:51.153137 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403535c-47c9-4f63-a397-e0008488811c None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:51.153692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403535c-47c9-4f63-a397-e0008488811c None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:51.154245 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403535c-47c9-4f63-a397-e0008488811c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:51.176281 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-d403535c-47c9-4f63-a397-e0008488811c None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:51.177676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-d403535c-47c9-4f63-a397-e0008488811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:51.190031 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750b99b-6869-48c6-901a-c3bc65297e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:51.191194 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750b99b-6869-48c6-901a-c3bc65297e59 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:51.192160 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750b99b-6869-48c6-901a-c3bc65297e59 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:51.192797 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750b99b-6869-48c6-901a-c3bc65297e59 None admin] PATH_INFO: `/v3/groups/ea48d097f84644109f7aa1a1d6e42118` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:51.194379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750b99b-6869-48c6-901a-c3bc65297e59 None admin] RBAC: Authorizing `identity:get_group(group_id=ea48d097f84644109f7aa1a1d6e42118)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:51.196154 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750b99b-6869-48c6-901a-c3bc65297e59 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:51.199635 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 201/414] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 17 14:46:51 2022] GET /identity/v3/groups/ea48d097f84644109f7aa1a1d6e42118 => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:51.207552 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750b99b-6869-48c6-901a-c3bc65297e59 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:51.266170 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 214/415] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:46:51.334556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750b99b-6869-48c6-901a-c3bc65297e59 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:51.371782 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11196f5-dc48-44ee-ac2d-7828c13ef40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:51.372736 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11196f5-dc48-44ee-ac2d-7828c13ef40d None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:51.373211 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11196f5-dc48-44ee-ac2d-7828c13ef40d None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:51.373707 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11196f5-dc48-44ee-ac2d-7828c13ef40d None admin] PATH_INFO: `/v3/projects/09a5e42d9b6e4e598b40571f10c289e0` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:51.375071 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11196f5-dc48-44ee-ac2d-7828c13ef40d None admin] RBAC: Authorizing `identity:get_project(project_id=09a5e42d9b6e4e598b40571f10c289e0)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:51.376701 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11196f5-dc48-44ee-ac2d-7828c13ef40d None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:51.378867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 202/416] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:51 2022] GET /identity/v3/projects/09a5e42d9b6e4e598b40571f10c289e0 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:51.384475 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403535c-47c9-4f63-a397-e0008488811c None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:51.503337 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:51.513718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403535c-47c9-4f63-a397-e0008488811c None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:51.565762 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082f6f6-e235-4269-bc5d-0ed4a9a3f47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:51.565762 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082f6f6-e235-4269-bc5d-0ed4a9a3f47c None admin] REQUEST_METHOD: `PUT` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:51.565762 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082f6f6-e235-4269-bc5d-0ed4a9a3f47c None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:51.565762 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082f6f6-e235-4269-bc5d-0ed4a9a3f47c None admin] PATH_INFO: `/v3/projects/09a5e42d9b6e4e598b40571f10c289e0/groups/ea48d097f84644109f7aa1a1d6e42118/roles/a307f157f2a445c7af8bd4fd41aa1c4b` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:51.566713 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082f6f6-e235-4269-bc5d-0ed4a9a3f47c None admin] RBAC: Authorizing `identity:create_grant(project_id=09a5e42d9b6e4e598b40571f10c289e0, group_id=ea48d097f84644109f7aa1a1d6e42118, role_id=a307f157f2a445c7af8bd4fd41aa1c4b)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:51.568151 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082f6f6-e235-4269-bc5d-0ed4a9a3f47c None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:51.604913 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 215/417] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Aug 17 14:46:51 2022] PUT /identity/v3/projects/09a5e42d9b6e4e598b40571f10c289e0/groups/ea48d097f84644109f7aa1a1d6e42118/roles/a307f157f2a445c7af8bd4fd41aa1c4b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:46:51.740863 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11196f5-dc48-44ee-ac2d-7828c13ef40d None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:51.780856 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:51.881960 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11196f5-dc48-44ee-ac2d-7828c13ef40d None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:51.917361 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65e819-c12b-4522-a3f2-022970ad52ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:51.918819 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65e819-c12b-4522-a3f2-022970ad52ad None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:51.919094 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65e819-c12b-4522-a3f2-022970ad52ad None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:51.919352 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65e819-c12b-4522-a3f2-022970ad52ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:51.930060 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65e819-c12b-4522-a3f2-022970ad52ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:51.935818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-7d65e819-c12b-4522-a3f2-022970ad52ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:51.935818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:51.935818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:51.935818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:51.935818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:51.935818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:51.935818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:51.935818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:51.935818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:51.935818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:51.935818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:51.935818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:51.935818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:51.935818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:51.935818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:51.935818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:51.936726 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:51.936726 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:51.936726 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:51.936726 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:51.936726 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:51.936726 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:51.936726 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:51.936726 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:51.936726 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:51.936726 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:51.936726 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:51.936726 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:51.936726 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:51.936726 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:51.936726 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:51.936726 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:51.937518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:51.937518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:51.937518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:51.937518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:51.937518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:51.937518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:51.937518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:51.937518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:51.937518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:51.937518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:51.937518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:51.937518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:51.937518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 203/418] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:51.943814 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082f6f6-e235-4269-bc5d-0ed4a9a3f47c None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:52.059630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082f6f6-e235-4269-bc5d-0ed4a9a3f47c None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:52.104850 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25958b85-312c-430b-a1ef-edcfa550667f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:52.106263 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25958b85-312c-430b-a1ef-edcfa550667f None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:52.106651 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25958b85-312c-430b-a1ef-edcfa550667f None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:52.106996 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25958b85-312c-430b-a1ef-edcfa550667f None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:52.107759 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25958b85-312c-430b-a1ef-edcfa550667f None admin] RBAC: Adding query filter params (name=member) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:52.108061 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25958b85-312c-430b-a1ef-edcfa550667f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:52.109473 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25958b85-312c-430b-a1ef-edcfa550667f None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:52.119826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 216/419] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:52.126496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65e819-c12b-4522-a3f2-022970ad52ad None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:52.218299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:52.234463 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65e819-c12b-4522-a3f2-022970ad52ad None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:52.272644 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7d139-eb83-4368-967b-65246828718f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:52.273243 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7d139-eb83-4368-967b-65246828718f None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:52.273521 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7d139-eb83-4368-967b-65246828718f None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:52.273822 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7d139-eb83-4368-967b-65246828718f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:52.345539 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7d139-eb83-4368-967b-65246828718f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:52.346944 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7d139-eb83-4368-967b-65246828718f None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:52.413884 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba06036-0277-4f7a-8c93-09b8ac3f3d98 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:52.414214 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba06036-0277-4f7a-8c93-09b8ac3f3d98 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:52.414432 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba06036-0277-4f7a-8c93-09b8ac3f3d98 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:52.415766 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 217/420] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:52.426649 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f76c2f-d088-427e-a17a-60bffb855634 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:52.427392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f76c2f-d088-427e-a17a-60bffb855634 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:52.427884 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f76c2f-d088-427e-a17a-60bffb855634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:52.445190 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:52.458610 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 204/421] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:52.459141 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-79f76c2f-d088-427e-a17a-60bffb855634 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:52.460488 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-79f76c2f-d088-427e-a17a-60bffb855634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:52.465375 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7d139-eb83-4368-967b-65246828718f None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:52.479127 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:52.547705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 218/422] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:52.571842 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7d139-eb83-4368-967b-65246828718f None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:52.607585 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b847697-9797-4eb6-87f3-a363719162b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:52.608132 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b847697-9797-4eb6-87f3-a363719162b9 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:52.608412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b847697-9797-4eb6-87f3-a363719162b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:52.608686 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b847697-9797-4eb6-87f3-a363719162b9 None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:52.609961 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b847697-9797-4eb6-87f3-a363719162b9 None admin] RBAC: Authorizing `identity:get_project(project_id=a7643b24b47f42eab63dd25e22c5cdb2)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:52.611426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b847697-9797-4eb6-87f3-a363719162b9 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:52.613353 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 205/423] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:52 2022] GET /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:52.618941 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f76c2f-d088-427e-a17a-60bffb855634 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:52.746666 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f76c2f-d088-427e-a17a-60bffb855634 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:52.790324 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95dc1b5-e055-4ea8-ab4e-2a606fada002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:52.790954 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dc1b5-e055-4ea8-ab4e-2a606fada002 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:52.791235 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dc1b5-e055-4ea8-ab4e-2a606fada002 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:52.791505 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dc1b5-e055-4ea8-ab4e-2a606fada002 None admin] PATH_INFO: `/v3/groups/3487e9172588429c83a62be3c43ce767` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:52.798377 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95dc1b5-e055-4ea8-ab4e-2a606fada002 None admin] RBAC: Authorizing `identity:get_group(group_id=3487e9172588429c83a62be3c43ce767)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:52.799818 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95dc1b5-e055-4ea8-ab4e-2a606fada002 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:52.801718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 219/424] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 17 14:46:52 2022] GET /identity/v3/groups/3487e9172588429c83a62be3c43ce767 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:52.807156 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b847697-9797-4eb6-87f3-a363719162b9 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:52.882584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:52.933303 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b847697-9797-4eb6-87f3-a363719162b9 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:52.963828 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95dc1b5-e055-4ea8-ab4e-2a606fada002 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:52.969883 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a82c56-15c4-46b2-acf5-a1638ebf3a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:52.970487 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a82c56-15c4-46b2-acf5-a1638ebf3a40 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:52.970762 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a82c56-15c4-46b2-acf5-a1638ebf3a40 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:52.971033 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a82c56-15c4-46b2-acf5-a1638ebf3a40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:52.971768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a82c56-15c4-46b2-acf5-a1638ebf3a40 None admin] RBAC: Adding query filter params (group.id=3487e9172588429c83a62be3c43ce767, role.id=ab06ca80774d48a191fece38e3f335ad, scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:52.972073 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a82c56-15c4-46b2-acf5-a1638ebf3a40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:52.973516 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a82c56-15c4-46b2-acf5-a1638ebf3a40 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:52.980691 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 206/425] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Aug 17 14:46:52 2022] GET /identity/v3/role_assignments?group.id=3487e9172588429c83a62be3c43ce767&scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2&role.id=ab06ca80774d48a191fece38e3f335ad => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:52.996626 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:53.107625 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95dc1b5-e055-4ea8-ab4e-2a606fada002 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:53.159247 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f2fbb-218c-4a40-9379-67c2e3bfb2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:53.160271 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f2fbb-218c-4a40-9379-67c2e3bfb2fe None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:53.160807 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f2fbb-218c-4a40-9379-67c2e3bfb2fe None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:53.161271 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f2fbb-218c-4a40-9379-67c2e3bfb2fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:53.195623 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f2fbb-218c-4a40-9379-67c2e3bfb2fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:53.201372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-534f2fbb-218c-4a40-9379-67c2e3bfb2fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:53.201372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:53.201372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:53.201372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:53.201372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:53.201372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:53.201372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:53.201372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:53.201372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:53.201372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:53.201372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:53.201372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:53.201372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:53.201372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:53.201372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:53.201372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:53.209157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:53.209157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:53.209157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:53.209157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:53.209157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:53.209157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:53.209157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:53.209157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:53.209157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:53.209157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:53.209157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:53.209157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:53.209157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:53.209157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:53.209157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:53.209157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:53.209978 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:53.209978 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:53.209978 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:53.209978 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:53.209978 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:53.209978 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:53.209978 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:53.209978 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:53.209978 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:53.209978 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:53.209978 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:53.209978 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:46:53.209978 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 220/426] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:46:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:46:53.210657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a82c56-15c4-46b2-acf5-a1638ebf3a40 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:53.381704 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdf29f-9c1c-4120-8ccb-1ec67be5ccc1 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:53.382417 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdf29f-9c1c-4120-8ccb-1ec67be5ccc1 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:53.382906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdf29f-9c1c-4120-8ccb-1ec67be5ccc1 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:53.384435 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 221/427] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:46:53.391558 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777ecda-be04-4d20-9c08-70fc6794f7c8 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:53.392127 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777ecda-be04-4d20-9c08-70fc6794f7c8 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:53.392592 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777ecda-be04-4d20-9c08-70fc6794f7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:53.428108 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-9777ecda-be04-4d20-9c08-70fc6794f7c8 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:53.429341 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-9777ecda-be04-4d20-9c08-70fc6794f7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:53.458215 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a82c56-15c4-46b2-acf5-a1638ebf3a40 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:53.478712 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:53.516303 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2386bb1-0955-4251-8ddd-8103e195c016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:53.516919 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2386bb1-0955-4251-8ddd-8103e195c016 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:53.517192 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2386bb1-0955-4251-8ddd-8103e195c016 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:53.517458 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2386bb1-0955-4251-8ddd-8103e195c016 None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:53.518166 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2386bb1-0955-4251-8ddd-8103e195c016 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:53.518465 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2386bb1-0955-4251-8ddd-8103e195c016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:53.519967 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2386bb1-0955-4251-8ddd-8103e195c016 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:53.534788 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 207/428] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:46:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:53.543575 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2386bb1-0955-4251-8ddd-8103e195c016 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:53.549977 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 222/429] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:46:53.672837 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2386bb1-0955-4251-8ddd-8103e195c016 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:53.711634 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ccc64-24a8-48be-a0ed-1f08e242b51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:53.712493 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ccc64-24a8-48be-a0ed-1f08e242b51e None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:53.712915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ccc64-24a8-48be-a0ed-1f08e242b51e None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:53.713324 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ccc64-24a8-48be-a0ed-1f08e242b51e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:53.770112 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:53.792117 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ccc64-24a8-48be-a0ed-1f08e242b51e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:53.794429 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ccc64-24a8-48be-a0ed-1f08e242b51e None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:53.842460 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10824b-1408-4a34-8833-33374a22b799 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:53.842761 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10824b-1408-4a34-8833-33374a22b799 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:53.843000 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10824b-1408-4a34-8833-33374a22b799 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:53.844560 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 223/430] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:46:53.849312 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d57ff-7460-46e7-95cf-7ac7315d2784 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:53.849591 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d57ff-7460-46e7-95cf-7ac7315d2784 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:53.849894 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d57ff-7460-46e7-95cf-7ac7315d2784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:53.866086 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:53.869157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-389d57ff-7460-46e7-95cf-7ac7315d2784 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:53.871088 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-389d57ff-7460-46e7-95cf-7ac7315d2784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:53.914679 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 208/431] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:53.921765 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ccc64-24a8-48be-a0ed-1f08e242b51e None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:53.974766 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 224/432] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:46:53.975543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d57ff-7460-46e7-95cf-7ac7315d2784 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:54.044481 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:54.075334 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ccc64-24a8-48be-a0ed-1f08e242b51e None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:54.093018 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d57ff-7460-46e7-95cf-7ac7315d2784 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:54.114304 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0202f-c2c3-42a3-aa0e-4ac5f06a9d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:54.114925 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0202f-c2c3-42a3-aa0e-4ac5f06a9d0c None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:54.115200 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0202f-c2c3-42a3-aa0e-4ac5f06a9d0c None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:54.115470 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0202f-c2c3-42a3-aa0e-4ac5f06a9d0c None admin] PATH_INFO: `/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:54.116591 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0202f-c2c3-42a3-aa0e-4ac5f06a9d0c None admin] RBAC: Authorizing `identity:get_project(project_id=a7643b24b47f42eab63dd25e22c5cdb2)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:54.118067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0202f-c2c3-42a3-aa0e-4ac5f06a9d0c None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:54.120038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 209/433] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:53 2022] GET /identity/v3/projects/a7643b24b47f42eab63dd25e22c5cdb2 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:54.126581 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0202f-c2c3-42a3-aa0e-4ac5f06a9d0c None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:54.140942 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cfbd1-ec00-417d-91f1-af9dfae37bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:54.141923 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cfbd1-ec00-417d-91f1-af9dfae37bf2 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:54.142422 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cfbd1-ec00-417d-91f1-af9dfae37bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:54.142887 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cfbd1-ec00-417d-91f1-af9dfae37bf2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:54.145833 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:54.154345 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7cfbd1-ec00-417d-91f1-af9dfae37bf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:54.159826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-8a7cfbd1-ec00-417d-91f1-af9dfae37bf2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:54.159826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:54.159826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:54.159826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:54.159826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:54.159826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:54.159826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:54.159826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:54.159826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:54.159826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:54.159826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:54.159826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:54.159826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:54.159826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:54.159826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:54.159826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:54.160917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:54.160917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:54.160917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:54.160917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:54.160917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:54.160917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:54.160917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:54.160917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:54.160917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:54.160917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:54.160917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:54.160917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:54.160917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:54.160917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:54.160917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:54.160917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:54.161968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:54.161968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:54.161968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:54.161968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:54.161968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:54.161968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:54.161968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:54.161968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:54.161968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:54.161968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:54.161968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:46:54.161968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:46:54.163731 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 225/434] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:54.170016 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cfbd1-ec00-417d-91f1-af9dfae37bf2 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:54.263250 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0202f-c2c3-42a3-aa0e-4ac5f06a9d0c None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:54.283030 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cfbd1-ec00-417d-91f1-af9dfae37bf2 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:54.304027 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99916db2-8b50-4ebd-8879-ad835c449dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:54.304982 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99916db2-8b50-4ebd-8879-ad835c449dec None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:54.305402 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99916db2-8b50-4ebd-8879-ad835c449dec None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:54.305862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99916db2-8b50-4ebd-8879-ad835c449dec None admin] PATH_INFO: `/v3/groups/3487e9172588429c83a62be3c43ce767` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:54.307123 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99916db2-8b50-4ebd-8879-ad835c449dec None admin] RBAC: Authorizing `identity:get_group(group_id=3487e9172588429c83a62be3c43ce767)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:54.309104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99916db2-8b50-4ebd-8879-ad835c449dec None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:54.311318 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 210/435] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 17 14:46:54 2022] GET /identity/v3/groups/3487e9172588429c83a62be3c43ce767 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:54.315148 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99916db2-8b50-4ebd-8879-ad835c449dec None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:54.328008 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7aaec2-7ef9-4f0e-9ce3-2124fd8700c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:54.328617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7aaec2-7ef9-4f0e-9ce3-2124fd8700c9 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:54.328894 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7aaec2-7ef9-4f0e-9ce3-2124fd8700c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:54.329172 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7aaec2-7ef9-4f0e-9ce3-2124fd8700c9 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:54.329867 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7aaec2-7ef9-4f0e-9ce3-2124fd8700c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:54.330167 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7aaec2-7ef9-4f0e-9ce3-2124fd8700c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:54.331528 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7aaec2-7ef9-4f0e-9ce3-2124fd8700c9 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:54.333227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:54.347330 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 226/436] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:46:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:54.347330 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7aaec2-7ef9-4f0e-9ce3-2124fd8700c9 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:54.409195 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:54.427897 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99916db2-8b50-4ebd-8879-ad835c449dec None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:54.457650 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7aaec2-7ef9-4f0e-9ce3-2124fd8700c9 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:54.466817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d6623-b2a4-42c9-beb4-111b32e28a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:54.467447 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d6623-b2a4-42c9-beb4-111b32e28a3b None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:54.467722 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d6623-b2a4-42c9-beb4-111b32e28a3b None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:54.467991 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d6623-b2a4-42c9-beb4-111b32e28a3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:54.480156 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d6623-b2a4-42c9-beb4-111b32e28a3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:54.486651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-569d6623-b2a4-42c9-beb4-111b32e28a3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:54.486651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:54.486651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:54.486651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:54.486651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:54.486651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:54.486651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:54.486651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:54.486651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:54.486651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:54.486651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:54.486651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:54.486651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:54.486651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:54.486651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:54.486651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:54.487523 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:54.487523 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:54.487523 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:54.487523 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:54.487523 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:54.487523 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:54.487523 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:54.487523 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:54.487523 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:54.487523 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:54.487523 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:54.487523 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:54.487523 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:54.487523 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:54.487523 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:54.487523 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:54.488327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:54.488327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:54.488327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:54.488327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:54.488327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:54.488327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:54.488327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:54.488327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:54.488327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:54.488327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:54.488327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:46:54.488327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:54.488948 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 211/437] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:46:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:46:54.489530 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d6623-b2a4-42c9-beb4-111b32e28a3b None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:54.500632 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea23da9-b2ca-481e-bfdf-e250dd1a4f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:54.501247 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea23da9-b2ca-481e-bfdf-e250dd1a4f89 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:54.501529 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea23da9-b2ca-481e-bfdf-e250dd1a4f89 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:54.501839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea23da9-b2ca-481e-bfdf-e250dd1a4f89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:54.502565 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea23da9-b2ca-481e-bfdf-e250dd1a4f89 None admin] RBAC: Adding query filter params (group.id=3487e9172588429c83a62be3c43ce767, role.id=df9fac15c20d418187fbaf38acafd61f, scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:54.502876 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea23da9-b2ca-481e-bfdf-e250dd1a4f89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:54.504409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea23da9-b2ca-481e-bfdf-e250dd1a4f89 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:54.518052 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 227/438] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Aug 17 14:46:54 2022] GET /identity/v3/role_assignments?group.id=3487e9172588429c83a62be3c43ce767&scope.project.id=a7643b24b47f42eab63dd25e22c5cdb2&role.id=df9fac15c20d418187fbaf38acafd61f => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:54.518052 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea23da9-b2ca-481e-bfdf-e250dd1a4f89 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:54.618079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:54.652984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea23da9-b2ca-481e-bfdf-e250dd1a4f89 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:54.659928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d6623-b2a4-42c9-beb4-111b32e28a3b None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:54.679499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:54.698527 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468e390-3f8f-4ab3-87a7-b5e6bb3f1e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:54.699431 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468e390-3f8f-4ab3-87a7-b5e6bb3f1e70 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:54.699971 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468e390-3f8f-4ab3-87a7-b5e6bb3f1e70 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:54.700317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468e390-3f8f-4ab3-87a7-b5e6bb3f1e70 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:54.701097 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468e390-3f8f-4ab3-87a7-b5e6bb3f1e70 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:54.701472 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468e390-3f8f-4ab3-87a7-b5e6bb3f1e70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:54.702988 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468e390-3f8f-4ab3-87a7-b5e6bb3f1e70 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:54.713335 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 228/439] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:46:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:54.714879 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f812c0-204d-4962-a349-ea11794321a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:54.715727 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f812c0-204d-4962-a349-ea11794321a3 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:54.715961 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f812c0-204d-4962-a349-ea11794321a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:54.716233 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f812c0-204d-4962-a349-ea11794321a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:54.719023 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e5267-43e1-462c-b969-90a0b31d7254 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:54.719331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e5267-43e1-462c-b969-90a0b31d7254 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:54.719591 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e5267-43e1-462c-b969-90a0b31d7254 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:54.720923 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 229/440] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:54.721839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e5267-43e1-462c-b969-90a0b31d7254 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:54.801956 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f812c0-204d-4962-a349-ea11794321a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:54.803492 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f812c0-204d-4962-a349-ea11794321a3 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:54.844524 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e5267-43e1-462c-b969-90a0b31d7254 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:54.895739 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:54.896791 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d0f62-7709-4a41-bbf1-06243ca8c1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:54.897505 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d0f62-7709-4a41-bbf1-06243ca8c1c8 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:54.897635 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d0f62-7709-4a41-bbf1-06243ca8c1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:54.897863 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d0f62-7709-4a41-bbf1-06243ca8c1c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:54.930309 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 212/441] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:54.935904 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61388a6-9476-49f3-86fd-0783f1fd9bb0 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:54.936356 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61388a6-9476-49f3-86fd-0783f1fd9bb0 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:54.936802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61388a6-9476-49f3-86fd-0783f1fd9bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:54.954749 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-e61388a6-9476-49f3-86fd-0783f1fd9bb0 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:54.955937 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-e61388a6-9476-49f3-86fd-0783f1fd9bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:54.961219 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:54.979058 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d0f62-7709-4a41-bbf1-06243ca8c1c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:54.981390 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d0f62-7709-4a41-bbf1-06243ca8c1c8 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:55.024726 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 213/442] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:55.025565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61388a6-9476-49f3-86fd-0783f1fd9bb0 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:55.081788 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 230/443] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:55.087208 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d0f62-7709-4a41-bbf1-06243ca8c1c8 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:55.141396 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61388a6-9476-49f3-86fd-0783f1fd9bb0 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:55.144920 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:55.174118 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:55.181701 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5446b-7338-4bad-a453-bb5ad26eb96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:55.182805 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5446b-7338-4bad-a453-bb5ad26eb96a None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:55.183598 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5446b-7338-4bad-a453-bb5ad26eb96a None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:55.183866 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5446b-7338-4bad-a453-bb5ad26eb96a None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:55.185475 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5446b-7338-4bad-a453-bb5ad26eb96a None admin] RBAC: Authorizing `identity:get_project(project_id=721977c9f4e7432d96ddc227894864f0)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:55.187395 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5446b-7338-4bad-a453-bb5ad26eb96a None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:55.193482 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d0f62-7709-4a41-bbf1-06243ca8c1c8 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:55.194318 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 214/444] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:55 2022] GET /identity/v3/projects/721977c9f4e7432d96ddc227894864f0 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:55.194985 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5446b-7338-4bad-a453-bb5ad26eb96a None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:55.234067 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5d628-c74d-4676-911f-47cb604ea4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:55.234868 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5d628-c74d-4676-911f-47cb604ea4c2 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:55.235146 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5d628-c74d-4676-911f-47cb604ea4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:55.236200 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5d628-c74d-4676-911f-47cb604ea4c2 None admin] PATH_INFO: `/v3/projects/721977c9f4e7432d96ddc227894864f0` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:55.237345 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5d628-c74d-4676-911f-47cb604ea4c2 None admin] RBAC: Authorizing `identity:get_project(project_id=721977c9f4e7432d96ddc227894864f0)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:55.238894 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5d628-c74d-4676-911f-47cb604ea4c2 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:55.241140 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 231/445] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:55 2022] GET /identity/v3/projects/721977c9f4e7432d96ddc227894864f0 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:55.247252 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5d628-c74d-4676-911f-47cb604ea4c2 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:55.311741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5446b-7338-4bad-a453-bb5ad26eb96a None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:55.347746 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4a276-91fe-42a4-88ec-aee5b0ac215b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:55.348296 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4a276-91fe-42a4-88ec-aee5b0ac215b None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:55.348571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4a276-91fe-42a4-88ec-aee5b0ac215b None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:55.348856 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4a276-91fe-42a4-88ec-aee5b0ac215b None admin] PATH_INFO: `/v3/groups/3487e9172588429c83a62be3c43ce767` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:55.349980 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4a276-91fe-42a4-88ec-aee5b0ac215b None admin] RBAC: Authorizing `identity:get_group(group_id=3487e9172588429c83a62be3c43ce767)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:55.351108 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5d628-c74d-4676-911f-47cb604ea4c2 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:55.351406 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4a276-91fe-42a4-88ec-aee5b0ac215b None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:55.353115 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 215/446] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 17 14:46:55 2022] GET /identity/v3/groups/3487e9172588429c83a62be3c43ce767 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:55.358909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4a276-91fe-42a4-88ec-aee5b0ac215b None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:55.386904 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602ce8f-2472-4b42-a200-8b1911f09769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:55.387534 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602ce8f-2472-4b42-a200-8b1911f09769 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:55.387814 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602ce8f-2472-4b42-a200-8b1911f09769 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:55.388083 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602ce8f-2472-4b42-a200-8b1911f09769 None admin] PATH_INFO: `/v3/groups/3487e9172588429c83a62be3c43ce767` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:55.389222 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602ce8f-2472-4b42-a200-8b1911f09769 None admin] RBAC: Authorizing `identity:get_group(group_id=3487e9172588429c83a62be3c43ce767)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:55.390698 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602ce8f-2472-4b42-a200-8b1911f09769 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:55.392257 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 232/447] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 17 14:46:55 2022] GET /identity/v3/groups/3487e9172588429c83a62be3c43ce767 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:55.394595 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602ce8f-2472-4b42-a200-8b1911f09769 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:55.401492 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:55.416190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:55.460170 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4a276-91fe-42a4-88ec-aee5b0ac215b None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:55.494095 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602ce8f-2472-4b42-a200-8b1911f09769 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:55.495359 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38111693-0fb1-485c-8338-c0ddb568a514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:55.496430 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38111693-0fb1-485c-8338-c0ddb568a514 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:55.496708 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38111693-0fb1-485c-8338-c0ddb568a514 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:55.496981 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38111693-0fb1-485c-8338-c0ddb568a514 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:55.497712 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38111693-0fb1-485c-8338-c0ddb568a514 None admin] RBAC: Adding query filter params (group.id=3487e9172588429c83a62be3c43ce767, role.id=ab06ca80774d48a191fece38e3f335ad, scope.project.id=721977c9f4e7432d96ddc227894864f0) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:55.498052 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38111693-0fb1-485c-8338-c0ddb568a514 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:55.499472 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38111693-0fb1-485c-8338-c0ddb568a514 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:55.505185 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 216/448] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Aug 17 14:46:55 2022] GET /identity/v3/role_assignments?group.id=3487e9172588429c83a62be3c43ce767&scope.project.id=721977c9f4e7432d96ddc227894864f0&role.id=ab06ca80774d48a191fece38e3f335ad => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:55.505987 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38111693-0fb1-485c-8338-c0ddb568a514 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:55.540558 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c429c9-7e5d-4335-af18-3e8c78f10652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:55.541114 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c429c9-7e5d-4335-af18-3e8c78f10652 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:55.541390 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c429c9-7e5d-4335-af18-3e8c78f10652 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:55.542182 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c429c9-7e5d-4335-af18-3e8c78f10652 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:55.559090 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c429c9-7e5d-4335-af18-3e8c78f10652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:46:55.564933 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-d5c429c9-7e5d-4335-af18-3e8c78f10652 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:46:55.564933 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:55.564933 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:55.564933 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:55.564933 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:55.564933 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:55.564933 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:55.564933 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:55.564933 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:55.564933 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:55.564933 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:55.564933 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:55.564933 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:46:55.564933 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:46:55.564933 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:46:55.564933 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:46:55.565960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:46:55.565960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:46:55.565960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:46:55.565960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:46:55.565960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:55.565960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:55.565960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:55.565960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:55.565960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:55.565960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:55.565960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:55.565960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:55.565960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:55.565960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:55.565960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:55.565960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:55.566746 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:55.566746 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:55.566746 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:55.566746 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:55.566746 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:46:55.566746 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:46:55.566746 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:46:55.566746 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:46:55.566746 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:46:55.566746 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:46:55.566746 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:46:55.566746 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:46:55.566746 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 233/449] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 17 14:46:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:55.573023 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c429c9-7e5d-4335-af18-3e8c78f10652 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:55.640834 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38111693-0fb1-485c-8338-c0ddb568a514 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:55.644414 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:55.666843 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:55.685510 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0b69b-001a-4b4b-a85d-a658ebca8050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:55.686287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0b69b-001a-4b4b-a85d-a658ebca8050 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:55.686568 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0b69b-001a-4b4b-a85d-a658ebca8050 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:55.686838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0b69b-001a-4b4b-a85d-a658ebca8050 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:55.687569 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0b69b-001a-4b4b-a85d-a658ebca8050 None admin] RBAC: Adding query filter params (group.id=3487e9172588429c83a62be3c43ce767, role.id=df9fac15c20d418187fbaf38acafd61f, scope.project.id=721977c9f4e7432d96ddc227894864f0) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:55.687882 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0b69b-001a-4b4b-a85d-a658ebca8050 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:55.689312 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0b69b-001a-4b4b-a85d-a658ebca8050 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:55.691507 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c429c9-7e5d-4335-af18-3e8c78f10652 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:55.696852 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 217/450] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Aug 17 14:46:55 2022] GET /identity/v3/role_assignments?group.id=3487e9172588429c83a62be3c43ce767&scope.project.id=721977c9f4e7432d96ddc227894864f0&role.id=df9fac15c20d418187fbaf38acafd61f => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:55.732898 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713553c-2ed2-4bb5-a564-7443bc774d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:55.733523 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713553c-2ed2-4bb5-a564-7443bc774d85 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:55.733828 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713553c-2ed2-4bb5-a564-7443bc774d85 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:55.734098 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713553c-2ed2-4bb5-a564-7443bc774d85 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:55.734782 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713553c-2ed2-4bb5-a564-7443bc774d85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:55.735077 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713553c-2ed2-4bb5-a564-7443bc774d85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:55.736482 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713553c-2ed2-4bb5-a564-7443bc774d85 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:55.746873 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 234/451] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:46:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:46:55.752737 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0b69b-001a-4b4b-a85d-a658ebca8050 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:55.877357 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0b69b-001a-4b4b-a85d-a658ebca8050 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:55.913587 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cf0ae-5af3-4984-841f-3a546c0969f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:55.914510 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cf0ae-5af3-4984-841f-3a546c0969f0 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:55.914792 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cf0ae-5af3-4984-841f-3a546c0969f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:55.915066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cf0ae-5af3-4984-841f-3a546c0969f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:55.951683 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:55.989138 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003cf0ae-5af3-4984-841f-3a546c0969f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:55.990631 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003cf0ae-5af3-4984-841f-3a546c0969f0 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:56.094320 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 218/452] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:46:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:46:56.099955 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713553c-2ed2-4bb5-a564-7443bc774d85 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:56.197754 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713553c-2ed2-4bb5-a564-7443bc774d85 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:56.229684 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577e201-5a2b-4d2d-ac1c-2e8adf46964f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:56.231206 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577e201-5a2b-4d2d-ac1c-2e8adf46964f None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:56.231490 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577e201-5a2b-4d2d-ac1c-2e8adf46964f None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:56.231756 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577e201-5a2b-4d2d-ac1c-2e8adf46964f None admin] PATH_INFO: `/v3/projects/09a5e42d9b6e4e598b40571f10c289e0` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:56.232864 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577e201-5a2b-4d2d-ac1c-2e8adf46964f None admin] RBAC: Authorizing `identity:get_project(project_id=09a5e42d9b6e4e598b40571f10c289e0)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:56.234313 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577e201-5a2b-4d2d-ac1c-2e8adf46964f None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:56.235883 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 235/453] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Aug 17 14:46:56 2022] GET /identity/v3/projects/09a5e42d9b6e4e598b40571f10c289e0 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:56.241346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cf0ae-5af3-4984-841f-3a546c0969f0 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:56.310345 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:56.344057 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cf0ae-5af3-4984-841f-3a546c0969f0 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:56.377916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2e0cc-c377-4083-8153-875bcf5ca874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:56.378528 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2e0cc-c377-4083-8153-875bcf5ca874 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:56.378805 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2e0cc-c377-4083-8153-875bcf5ca874 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:56.379075 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2e0cc-c377-4083-8153-875bcf5ca874 None admin] PATH_INFO: `/v3/groups/ea48d097f84644109f7aa1a1d6e42118` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:56.380167 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2e0cc-c377-4083-8153-875bcf5ca874 None admin] RBAC: Authorizing `identity:get_group(group_id=ea48d097f84644109f7aa1a1d6e42118)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:56.381606 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2e0cc-c377-4083-8153-875bcf5ca874 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:56.383344 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 219/454] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Aug 17 14:46:56 2022] GET /identity/v3/groups/ea48d097f84644109f7aa1a1d6e42118 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:56.389671 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577e201-5a2b-4d2d-ac1c-2e8adf46964f None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:56.402689 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:56.487394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577e201-5a2b-4d2d-ac1c-2e8adf46964f None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:56.519474 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df33e8-c5fd-4fb2-b11f-53948ab59484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:56.520061 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df33e8-c5fd-4fb2-b11f-53948ab59484 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:56.520341 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df33e8-c5fd-4fb2-b11f-53948ab59484 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:56.520612 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df33e8-c5fd-4fb2-b11f-53948ab59484 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:56.521328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df33e8-c5fd-4fb2-b11f-53948ab59484 None admin] RBAC: Adding query filter params (group.id=ea48d097f84644109f7aa1a1d6e42118, role.id=a307f157f2a445c7af8bd4fd41aa1c4b, scope.project.id=09a5e42d9b6e4e598b40571f10c289e0) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:56.521639 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df33e8-c5fd-4fb2-b11f-53948ab59484 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:56.523079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df33e8-c5fd-4fb2-b11f-53948ab59484 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:56.529438 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 236/455] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Aug 17 14:46:56 2022] GET /identity/v3/role_assignments?group.id=ea48d097f84644109f7aa1a1d6e42118&scope.project.id=09a5e42d9b6e4e598b40571f10c289e0&role.id=a307f157f2a445c7af8bd4fd41aa1c4b => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:59.039237 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d337a2-f6ab-4f8b-aab2-e4a4d66821a2 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:59.042147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d337a2-f6ab-4f8b-aab2-e4a4d66821a2 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:59.042147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d337a2-f6ab-4f8b-aab2-e4a4d66821a2 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:59.042397 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 220/456] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:59.048663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc18f7-c0bf-4f25-8118-eefe39d4a1cf None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:59.050288 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc18f7-c0bf-4f25-8118-eefe39d4a1cf None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:59.050773 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc18f7-c0bf-4f25-8118-eefe39d4a1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:59.070215 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-a0bc18f7-c0bf-4f25-8118-eefe39d4a1cf None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:59.071767 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-a0bc18f7-c0bf-4f25-8118-eefe39d4a1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:59.147314 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 237/457] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:59.192863 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1744ac-c521-4301-bfb9-e178a1917c93 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:59.193483 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1744ac-c521-4301-bfb9-e178a1917c93 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:59.193997 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1744ac-c521-4301-bfb9-e178a1917c93 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:59.195967 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 221/458] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:59.202984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c05b03-492b-4f72-b863-157b36896ec5 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:59.203627 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c05b03-492b-4f72-b863-157b36896ec5 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:59.204119 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c05b03-492b-4f72-b863-157b36896ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:59.212106 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:59.227343 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-38c05b03-492b-4f72-b863-157b36896ec5 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:59.228902 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-38c05b03-492b-4f72-b863-157b36896ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:59.310785 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 238/459] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:59.383664 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db64449-0a36-42a6-91be-108480499396 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:59.383976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db64449-0a36-42a6-91be-108480499396 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:59.384213 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db64449-0a36-42a6-91be-108480499396 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:59.385659 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 222/460] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:59.391445 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550272d-566e-4128-b5a3-62fd7291ada2 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:59.391733 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550272d-566e-4128-b5a3-62fd7291ada2 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:59.392001 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550272d-566e-4128-b5a3-62fd7291ada2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:59.410452 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-6550272d-566e-4128-b5a3-62fd7291ada2 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:46:59.411933 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-6550272d-566e-4128-b5a3-62fd7291ada2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:46:59.482821 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 239/461] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:46:59.492921 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db64449-0a36-42a6-91be-108480499396 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:59.608103 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db64449-0a36-42a6-91be-108480499396 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:59.643429 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd707a91-7975-45c2-866a-afc53acd12fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:59.644046 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd707a91-7975-45c2-866a-afc53acd12fa None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:59.644321 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd707a91-7975-45c2-866a-afc53acd12fa None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:59.644588 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd707a91-7975-45c2-866a-afc53acd12fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:59.647352 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:59.649667 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550272d-566e-4128-b5a3-62fd7291ada2 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:59.656117 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd707a91-7975-45c2-866a-afc53acd12fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:59.657576 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd707a91-7975-45c2-866a-afc53acd12fa None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:59.673966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-dd707a91-7975-45c2-866a-afc53acd12fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:46:59.673966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:59.673966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:59.673966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:59.673966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:59.673966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:59.673966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:59.673966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:59.673966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:59.673966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:59.673966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:59.673966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:59.673966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:46:59.673966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:46:59.673966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:46:59.673966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:46:59.674930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:59.674930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:59.674930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:59.674930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:59.674930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:59.674930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:59.674930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:59.674930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:59.674930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:59.674930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:59.674930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:59.674930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:59.674930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:59.674930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:59.674930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:59.674930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:59.674930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:46:59.675765 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:46:59.675765 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:46:59.675765 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:46:59.675765 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 223/462] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:59.681664 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd707a91-7975-45c2-866a-afc53acd12fa None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:59.728366 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:59.771296 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550272d-566e-4128-b5a3-62fd7291ada2 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:59.800361 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd707a91-7975-45c2-866a-afc53acd12fa None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:59.810342 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70baa3c3-8c85-45a0-827b-57eb2e5ad0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:59.810965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70baa3c3-8c85-45a0-827b-57eb2e5ad0ab None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:59.811242 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70baa3c3-8c85-45a0-827b-57eb2e5ad0ab None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:59.811509 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70baa3c3-8c85-45a0-827b-57eb2e5ad0ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:59.822057 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70baa3c3-8c85-45a0-827b-57eb2e5ad0ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:59.823530 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70baa3c3-8c85-45a0-827b-57eb2e5ad0ab None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:59.836609 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaa1e0-66f3-4f9e-bce3-685468caeb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:59.837204 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaa1e0-66f3-4f9e-bce3-685468caeb22 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:59.837485 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaa1e0-66f3-4f9e-bce3-685468caeb22 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:59.837776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaa1e0-66f3-4f9e-bce3-685468caeb22 None admin] PATH_INFO: `/v3/domains` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:59.838392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-70baa3c3-8c85-45a0-827b-57eb2e5ad0ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:46:59.838392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:46:59.838392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:46:59.838392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:46:59.838392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:46:59.838392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:46:59.838392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:46:59.838392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:46:59.838392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:46:59.838392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:46:59.838392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:46:59.838392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:46:59.838392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:46:59.838392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:46:59.838392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:46:59.838392 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:46:59.839822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:46:59.839822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:46:59.839822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:46:59.839822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:46:59.839822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:46:59.839822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:46:59.839822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:46:59.839822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:46:59.839822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:46:59.839822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:46:59.839822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:46:59.839822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:46:59.839822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:46:59.839822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:46:59.839822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:46:59.839822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:46:59.839822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:46:59.840916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:46:59.840916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:46:59.840916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:46:59.841075 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaa1e0-66f3-4f9e-bce3-685468caeb22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:59.841075 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaa1e0-66f3-4f9e-bce3-685468caeb22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:59.841075 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaa1e0-66f3-4f9e-bce3-685468caeb22 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:59.844459 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 240/463] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:46:59.845987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce94687-4b4d-4814-b56e-5da5cf90a535 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:59.846264 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce94687-4b4d-4814-b56e-5da5cf90a535 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:59.846531 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce94687-4b4d-4814-b56e-5da5cf90a535 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:59.847791 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 241/464] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:46:59.848494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce94687-4b4d-4814-b56e-5da5cf90a535 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:59.859678 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 224/465] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:46:59.862638 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaa1e0-66f3-4f9e-bce3-685468caeb22 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:46:59.911032 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:59.951664 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce94687-4b4d-4814-b56e-5da5cf90a535 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:59.960521 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaa1e0-66f3-4f9e-bce3-685468caeb22 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:46:59.967251 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:46:59.985881 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a7c7d-8848-46ec-8e2e-169d38378bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:59.986509 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a7c7d-8848-46ec-8e2e-169d38378bc1 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:59.986787 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a7c7d-8848-46ec-8e2e-169d38378bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:59.987065 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a7c7d-8848-46ec-8e2e-169d38378bc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:59.996050 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177ce2d-c6a3-445a-a604-c4cf90435bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:46:59.996605 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177ce2d-c6a3-445a-a604-c4cf90435bf0 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:46:59.996882 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177ce2d-c6a3-445a-a604-c4cf90435bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:46:59.997154 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177ce2d-c6a3-445a-a604-c4cf90435bf0 None admin] PATH_INFO: `/v3/domains` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:46:59.997826 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177ce2d-c6a3-445a-a604-c4cf90435bf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:46:59.998131 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177ce2d-c6a3-445a-a604-c4cf90435bf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:59.998276 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a7c7d-8848-46ec-8e2e-169d38378bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:46:59.999520 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177ce2d-c6a3-445a-a604-c4cf90435bf0 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:46:59.999696 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a7c7d-8848-46ec-8e2e-169d38378bc1 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:00.010974 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 225/466] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:00.012734 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3507c-05f2-4062-b937-61decefc892b None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:00.013024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3507c-05f2-4062-b937-61decefc892b None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:00.013300 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3507c-05f2-4062-b937-61decefc892b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:00.014668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-652a7c7d-8848-46ec-8e2e-169d38378bc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:00.014668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:00.014668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:00.014668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:00.014668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:00.014668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:00.014668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:00.014668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:00.014668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:00.014668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:00.014668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:00.014668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:00.014668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:00.014668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:00.014668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:00.014668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:00.015501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:00.015501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:00.015501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:00.015501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:00.015501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:00.015501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:00.015501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:00.015501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:00.015501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:00.015501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:00.015501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:00.015501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:00.015501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:00.015501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:00.015501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:00.015501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:00.015501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:00.018247 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:00.018247 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:00.018247 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:00.018247 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 242/467] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:00.018247 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a7c7d-8848-46ec-8e2e-169d38378bc1 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:00.032711 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-21f3507c-05f2-4062-b937-61decefc892b None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:00.033943 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-21f3507c-05f2-4062-b937-61decefc892b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:00.102048 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 226/468] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:47:00.102856 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3507c-05f2-4062-b937-61decefc892b None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:00.118556 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a7c7d-8848-46ec-8e2e-169d38378bc1 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:00.143652 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:00.157033 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8baced-5306-403a-8b9c-362ca3fd6d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:00.157666 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8baced-5306-403a-8b9c-362ca3fd6d4b None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:00.157975 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8baced-5306-403a-8b9c-362ca3fd6d4b None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:00.158250 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8baced-5306-403a-8b9c-362ca3fd6d4b None admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:00.158887 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8baced-5306-403a-8b9c-362ca3fd6d4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:00.160322 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8baced-5306-403a-8b9c-362ca3fd6d4b None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:00.189104 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 243/469] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 17 14:47:00 2022] POST /identity/v3/users => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:47:00.202825 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8baced-5306-403a-8b9c-362ca3fd6d4b None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:00.220287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3507c-05f2-4062-b937-61decefc892b None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:00.244017 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:00.269372 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86620c6-49c1-46a8-a6cc-f19a8a3ba218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:00.270651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86620c6-49c1-46a8-a6cc-f19a8a3ba218 None admin] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:00.270915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86620c6-49c1-46a8-a6cc-f19a8a3ba218 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:00.271186 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86620c6-49c1-46a8-a6cc-f19a8a3ba218 None admin] PATH_INFO: `/v3/users` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:00.271840 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86620c6-49c1-46a8-a6cc-f19a8a3ba218 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:00.273392 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86620c6-49c1-46a8-a6cc-f19a8a3ba218 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:00.309761 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 227/470] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 17 14:47:00 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:47:00.360889 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8baced-5306-403a-8b9c-362ca3fd6d4b None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:00.412519 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3eaf6-037d-48b0-b2ad-db5853aa269b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:00.413075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3eaf6-037d-48b0-b2ad-db5853aa269b None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:00.413415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3eaf6-037d-48b0-b2ad-db5853aa269b None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:00.413691 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3eaf6-037d-48b0-b2ad-db5853aa269b None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:00.414388 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3eaf6-037d-48b0-b2ad-db5853aa269b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:00.414692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3eaf6-037d-48b0-b2ad-db5853aa269b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:00.416159 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3eaf6-037d-48b0-b2ad-db5853aa269b None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:00.431790 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 244/471] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:00.438548 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86620c6-49c1-46a8-a6cc-f19a8a3ba218 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:00.448574 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3eaf6-037d-48b0-b2ad-db5853aa269b None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:00.565152 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:00.571872 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:00.575246 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86620c6-49c1-46a8-a6cc-f19a8a3ba218 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:00.592350 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3eaf6-037d-48b0-b2ad-db5853aa269b None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:00.628180 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892001e-4ded-49fb-a978-cbc90d623592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:00.628734 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892001e-4ded-49fb-a978-cbc90d623592 None admin] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:00.629022 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892001e-4ded-49fb-a978-cbc90d623592 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:00.629273 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892001e-4ded-49fb-a978-cbc90d623592 None admin] PATH_INFO: `/v3/users` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:00.629970 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892001e-4ded-49fb-a978-cbc90d623592 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:00.631627 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892001e-4ded-49fb-a978-cbc90d623592 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:00.636701 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1c6a7-7640-4584-a19a-07fe4962f547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:00.637411 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1c6a7-7640-4584-a19a-07fe4962f547 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:00.637761 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1c6a7-7640-4584-a19a-07fe4962f547 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:00.638115 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1c6a7-7640-4584-a19a-07fe4962f547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:00.650333 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1c6a7-7640-4584-a19a-07fe4962f547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:00.652335 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1c6a7-7640-4584-a19a-07fe4962f547 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:00.658777 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 228/472] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 17 14:47:00 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:47:00.672123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-5bf1c6a7-7640-4584-a19a-07fe4962f547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:00.672123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:00.672123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:00.672123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:00.672123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:00.672123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:00.672123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:00.672123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:00.672123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:00.672123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:00.672123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:00.672123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:00.672123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:00.672123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:00.672123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:00.672123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:00.673190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:00.673190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:00.673190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:00.673190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:00.673190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:00.673190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:00.673190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:00.673190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:00.673190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:00.673190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:00.673190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:00.673190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:00.673190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:00.673190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:00.673190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:00.673190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:00.673190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:00.674708 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:00.674708 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:00.674708 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:00.674708 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 245/473] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:47:00.680001 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892001e-4ded-49fb-a978-cbc90d623592 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:00.797538 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892001e-4ded-49fb-a978-cbc90d623592 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:00.835926 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce19e0-f935-4de3-9198-3a136a1f6f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:00.836902 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce19e0-f935-4de3-9198-3a136a1f6f18 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:00.837182 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce19e0-f935-4de3-9198-3a136a1f6f18 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:00.837450 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce19e0-f935-4de3-9198-3a136a1f6f18 None admin] PATH_INFO: `/v3/domains` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:00.838210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce19e0-f935-4de3-9198-3a136a1f6f18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:00.838511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce19e0-f935-4de3-9198-3a136a1f6f18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:00.840935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce19e0-f935-4de3-9198-3a136a1f6f18 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:00.853321 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 229/474] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:00.859226 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1c6a7-7640-4584-a19a-07fe4962f547 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:00.972009 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1c6a7-7640-4584-a19a-07fe4962f547 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:01.006799 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960f9a2-ce84-47f3-a9e8-9e8205432003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:01.007496 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960f9a2-ce84-47f3-a9e8-9e8205432003 None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:01.007780 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960f9a2-ce84-47f3-a9e8-9e8205432003 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:01.008058 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960f9a2-ce84-47f3-a9e8-9e8205432003 None admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:01.008700 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960f9a2-ce84-47f3-a9e8-9e8205432003 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:01.010170 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960f9a2-ce84-47f3-a9e8-9e8205432003 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:01.020239 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:01.036171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 246/475] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 17 14:47:00 2022] POST /identity/v3/users => generated 249 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:47:02.611170 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b5de8-3cfe-44e3-8355-659b04c153e0 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:02.611674 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b5de8-3cfe-44e3-8355-659b04c153e0 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:02.611746 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b5de8-3cfe-44e3-8355-659b04c153e0 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:02.613288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 230/476] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:02.618401 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2f95b-8934-4677-9ae9-0d5d14d7f486 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:02.618782 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2f95b-8934-4677-9ae9-0d5d14d7f486 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:02.618939 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2f95b-8934-4677-9ae9-0d5d14d7f486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:02.638100 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-77a2f95b-8934-4677-9ae9-0d5d14d7f486 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:02.639293 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-77a2f95b-8934-4677-9ae9-0d5d14d7f486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:02.697330 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556193d6-18ae-4cc4-891b-929ca98467da None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:02.697649 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556193d6-18ae-4cc4-891b-929ca98467da None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:02.697944 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556193d6-18ae-4cc4-891b-929ca98467da None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:02.700024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 231/477] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:02.705130 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1f2a-bcbe-4ed9-8349-b35d14eeea93 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:02.705493 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1f2a-bcbe-4ed9-8349-b35d14eeea93 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:02.706278 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1f2a-bcbe-4ed9-8349-b35d14eeea93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:02.717096 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 247/478] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:47:02.727126 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-d50a1f2a-bcbe-4ed9-8349-b35d14eeea93 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:02.728384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-d50a1f2a-bcbe-4ed9-8349-b35d14eeea93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:02.732237 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:02.808974 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 232/479] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:47:02.953629 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a194fb-b81d-44ae-9b0d-d3b2626fb343 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:02.954328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a194fb-b81d-44ae-9b0d-d3b2626fb343 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:02.954800 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a194fb-b81d-44ae-9b0d-d3b2626fb343 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:02.956656 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 248/480] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:02.961952 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9c189-13aa-4fd5-aa75-823780aee1c8 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:02.962239 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9c189-13aa-4fd5-aa75-823780aee1c8 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:02.962513 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9c189-13aa-4fd5-aa75-823780aee1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:02.980931 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-bda9c189-13aa-4fd5-aa75-823780aee1c8 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:02.982158 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-bda9c189-13aa-4fd5-aa75-823780aee1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:03.053690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 233/481] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:47:03.069504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a194fb-b81d-44ae-9b0d-d3b2626fb343 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:03.142199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9c189-13aa-4fd5-aa75-823780aee1c8 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:03.183734 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a194fb-b81d-44ae-9b0d-d3b2626fb343 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:03.215785 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:03.222274 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:03.232893 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf735b-b30f-4daf-8091-d5446605410a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:03.234094 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf735b-b30f-4daf-8091-d5446605410a None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:03.234379 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf735b-b30f-4daf-8091-d5446605410a None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:03.234651 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf735b-b30f-4daf-8091-d5446605410a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:03.250552 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf735b-b30f-4daf-8091-d5446605410a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:47:03.257259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-52bf735b-b30f-4daf-8091-d5446605410a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:03.257259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:03.257259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:03.257259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:03.257259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:03.257259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:03.257259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:03.257259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:03.257259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:03.257259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:03.257259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:03.257259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:03.257259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:47:03.257259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:47:03.257259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:47:03.257259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:47:03.258417 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:47:03.258417 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:47:03.258417 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:47:03.258417 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:47:03.258417 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:03.258417 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:03.258417 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:03.258417 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:03.258417 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:03.258417 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:03.258417 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:03.258417 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:03.258417 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:03.258417 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:03.258417 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:03.258417 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:03.259391 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:03.259391 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:03.259391 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:03.259391 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:03.259391 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:47:03.259391 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:47:03.259391 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:47:03.259391 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:47:03.259391 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:47:03.259391 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:47:03.259391 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:03.259391 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:03.261806 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 249/482] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 17 14:47:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:03.265536 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf735b-b30f-4daf-8091-d5446605410a None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:03.268185 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9c189-13aa-4fd5-aa75-823780aee1c8 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:03.314124 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd370d27-dbe7-40a2-80ac-14ca1c14451c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:03.314753 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd370d27-dbe7-40a2-80ac-14ca1c14451c None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:03.315393 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd370d27-dbe7-40a2-80ac-14ca1c14451c None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:03.315667 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd370d27-dbe7-40a2-80ac-14ca1c14451c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:03.329924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd370d27-dbe7-40a2-80ac-14ca1c14451c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:47:03.335615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-cd370d27-dbe7-40a2-80ac-14ca1c14451c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:03.335615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:03.335615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:03.335615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:03.335615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:03.335615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:03.335615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:03.335615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:03.335615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:03.335615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:03.335615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:03.335615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:03.335615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:47:03.335615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:47:03.335615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:47:03.335615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:47:03.336491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:47:03.336491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:47:03.336491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:47:03.336491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:47:03.336491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:03.336491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:03.336491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:03.336491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:03.336491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:03.336491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:03.336491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:03.336491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:03.336491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:03.336491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:03.336491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:03.336491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:03.342692 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:03.342692 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:03.342692 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:03.342692 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:03.342692 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:47:03.342692 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:47:03.342692 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:47:03.342692 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:47:03.342692 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:47:03.342692 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:47:03.342692 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:03.342692 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:03.342692 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 234/483] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 17 14:47:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:47:03.344995 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd370d27-dbe7-40a2-80ac-14ca1c14451c None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:03.379756 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf735b-b30f-4daf-8091-d5446605410a None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:03.416255 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b16d7c-5366-4ed5-be37-9c6017a7e930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:03.417760 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b16d7c-5366-4ed5-be37-9c6017a7e930 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:03.418398 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b16d7c-5366-4ed5-be37-9c6017a7e930 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:03.418730 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b16d7c-5366-4ed5-be37-9c6017a7e930 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:03.419347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b16d7c-5366-4ed5-be37-9c6017a7e930 None admin] RBAC: Adding query filter params (name=service) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:03.419645 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b16d7c-5366-4ed5-be37-9c6017a7e930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:03.421001 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b16d7c-5366-4ed5-be37-9c6017a7e930 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:03.428928 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 250/484] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 17 14:47:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:03.428928 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b16d7c-5366-4ed5-be37-9c6017a7e930 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:03.455289 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd370d27-dbe7-40a2-80ac-14ca1c14451c None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:03.477691 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:03.484019 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:03.490303 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8184a7f-d503-4f85-9a2c-cf91db5f1847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:03.490895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8184a7f-d503-4f85-9a2c-cf91db5f1847 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:03.491179 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8184a7f-d503-4f85-9a2c-cf91db5f1847 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:03.491436 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8184a7f-d503-4f85-9a2c-cf91db5f1847 None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:03.492086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8184a7f-d503-4f85-9a2c-cf91db5f1847 None admin] RBAC: Adding query filter params (name=service) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:03.492379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8184a7f-d503-4f85-9a2c-cf91db5f1847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:03.493800 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8184a7f-d503-4f85-9a2c-cf91db5f1847 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:03.507534 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 235/485] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 17 14:47:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:47:03.507534 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b8969-39fc-4902-a709-41d081572338 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:03.507534 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b8969-39fc-4902-a709-41d081572338 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:03.507534 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b8969-39fc-4902-a709-41d081572338 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:03.507534 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 236/486] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:03.507534 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b8969-39fc-4902-a709-41d081572338 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:03.540301 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b16d7c-5366-4ed5-be37-9c6017a7e930 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:03.574977 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4898e-f4c3-4a0b-afa1-455493c51c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:03.575606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4898e-f4c3-4a0b-afa1-455493c51c26 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:03.575882 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4898e-f4c3-4a0b-afa1-455493c51c26 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:03.576154 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4898e-f4c3-4a0b-afa1-455493c51c26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:03.590255 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4898e-f4c3-4a0b-afa1-455493c51c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:47:03.596906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-f4e4898e-f4c3-4a0b-afa1-455493c51c26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:03.596906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:03.596906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:03.596906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:03.596906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:03.596906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:03.596906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:03.596906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:03.596906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:03.596906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:03.596906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:03.596906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:03.596906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:47:03.596906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:47:03.596906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:47:03.596906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:47:03.597866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:47:03.597866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:47:03.597866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:47:03.597866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:47:03.597866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:03.597866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:03.597866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:03.597866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:03.597866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:03.597866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:03.597866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:03.597866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:03.597866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:03.597866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:03.597866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:03.597866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:03.598824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:03.598824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:03.598824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:03.598824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:03.598824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:47:03.598824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:47:03.598824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:47:03.598824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:47:03.598824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:47:03.598824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:47:03.598824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:03.598824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:03.598824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 251/487] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 17 14:47:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:03.599847 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4898e-f4c3-4a0b-afa1-455493c51c26 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:03.618236 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b8969-39fc-4902-a709-41d081572338 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:03.652530 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6994c47-5498-44a2-a0b6-2762403ae4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:03.653139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6994c47-5498-44a2-a0b6-2762403ae4c4 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:03.653478 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6994c47-5498-44a2-a0b6-2762403ae4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:03.653769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6994c47-5498-44a2-a0b6-2762403ae4c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:03.664008 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6994c47-5498-44a2-a0b6-2762403ae4c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:03.665456 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6994c47-5498-44a2-a0b6-2762403ae4c4 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:03.680496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-a6994c47-5498-44a2-a0b6-2762403ae4c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:03.680496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:03.680496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:03.680496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:03.680496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:03.680496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:03.680496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:03.680496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:03.680496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:03.680496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:03.680496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:03.680496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:03.680496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:03.680496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:03.680496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:03.680496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:03.681426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:03.681426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:03.681426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:03.681426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:03.681426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:03.681426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:03.681426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:03.681426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:03.681426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:03.681426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:03.681426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:03.681426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:03.681426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:03.681426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:03.681426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:03.681426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:03.681426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:03.682636 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:03.682636 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:03.682636 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:03.682636 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 237/488] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:03.683385 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81c085-0b93-436c-adb5-ed8f0b4676c2 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:03.683557 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81c085-0b93-436c-adb5-ed8f0b4676c2 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:03.684037 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81c085-0b93-436c-adb5-ed8f0b4676c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:03.702069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-ca81c085-0b93-436c-adb5-ed8f0b4676c2 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:03.702725 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4898e-f4c3-4a0b-afa1-455493c51c26 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:03.703236 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-ca81c085-0b93-436c-adb5-ed8f0b4676c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:03.705154 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:03.737192 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e4163-deba-4840-82dc-a82e2e7323e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:03.737847 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e4163-deba-4840-82dc-a82e2e7323e2 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:03.738123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e4163-deba-4840-82dc-a82e2e7323e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:03.738389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e4163-deba-4840-82dc-a82e2e7323e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:03.743639 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:03.749861 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e4163-deba-4840-82dc-a82e2e7323e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:03.751288 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e4163-deba-4840-82dc-a82e2e7323e2 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:03.765936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-4b1e4163-deba-4840-82dc-a82e2e7323e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:03.765936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:03.765936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:03.765936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:03.765936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:03.765936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:03.765936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:03.765936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:03.765936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:03.765936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:03.765936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:03.765936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:03.765936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:03.765936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:03.765936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:03.765936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:03.766925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:03.766925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:03.766925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:03.766925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:03.766925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:03.766925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:03.766925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:03.766925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:03.766925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:03.766925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:03.766925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:03.766925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:03.766925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:03.766925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:03.766925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:03.766925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:03.766925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:03.768170 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:03.768170 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:03.768170 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:03.768170 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 252/489] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:03.768170 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e4163-deba-4840-82dc-a82e2e7323e2 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:03.776693 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 238/490] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:47:03.778618 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81c085-0b93-436c-adb5-ed8f0b4676c2 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:03.873876 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e4163-deba-4840-82dc-a82e2e7323e2 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:03.882639 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81c085-0b93-436c-adb5-ed8f0b4676c2 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:03.908219 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a47f2e-8bd2-49f8-bd14-145f28ed0ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:03.908811 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a47f2e-8bd2-49f8-bd14-145f28ed0ce8 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:03.909100 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a47f2e-8bd2-49f8-bd14-145f28ed0ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:03.909378 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a47f2e-8bd2-49f8-bd14-145f28ed0ce8 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:03.910066 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a47f2e-8bd2-49f8-bd14-145f28ed0ce8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:03.910365 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a47f2e-8bd2-49f8-bd14-145f28ed0ce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:03.911730 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a47f2e-8bd2-49f8-bd14-145f28ed0ce8 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:03.918745 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78116a4e-d094-435f-b23b-6c511af4f1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:03.919348 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78116a4e-d094-435f-b23b-6c511af4f1d5 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:03.919629 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78116a4e-d094-435f-b23b-6c511af4f1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:03.919900 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78116a4e-d094-435f-b23b-6c511af4f1d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:03.924821 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 253/491] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 17 14:47:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:03.924960 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78116a4e-d094-435f-b23b-6c511af4f1d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:03.924960 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78116a4e-d094-435f-b23b-6c511af4f1d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:03.925091 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a47f2e-8bd2-49f8-bd14-145f28ed0ce8 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:03.925159 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78116a4e-d094-435f-b23b-6c511af4f1d5 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:03.940827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 239/492] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:03.940827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78116a4e-d094-435f-b23b-6c511af4f1d5 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:03.951184 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:03.976426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:04.037554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a47f2e-8bd2-49f8-bd14-145f28ed0ce8 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:04.049835 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78116a4e-d094-435f-b23b-6c511af4f1d5 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:04.074227 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21141ab2-9617-48ae-854f-a8215c9a4e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:04.074832 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21141ab2-9617-48ae-854f-a8215c9a4e39 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:04.075112 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21141ab2-9617-48ae-854f-a8215c9a4e39 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:04.075387 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21141ab2-9617-48ae-854f-a8215c9a4e39 None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:04.076024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21141ab2-9617-48ae-854f-a8215c9a4e39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:04.076326 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21141ab2-9617-48ae-854f-a8215c9a4e39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:04.077672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21141ab2-9617-48ae-854f-a8215c9a4e39 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:04.086893 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6266815-1dd9-4199-9873-3b6208faa2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:04.087582 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6266815-1dd9-4199-9873-3b6208faa2f4 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:04.087931 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6266815-1dd9-4199-9873-3b6208faa2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:04.088273 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6266815-1dd9-4199-9873-3b6208faa2f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:04.093573 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 254/493] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:04.093573 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21141ab2-9617-48ae-854f-a8215c9a4e39 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:04.103770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6266815-1dd9-4199-9873-3b6208faa2f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:04.107089 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6266815-1dd9-4199-9873-3b6208faa2f4 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:04.122253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-b6266815-1dd9-4199-9873-3b6208faa2f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:04.122253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:04.122253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:04.122253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:04.122253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:04.122253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:04.122253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:04.122253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:04.122253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:04.122253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:04.122253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:04.122253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:04.122253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:04.122253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:04.122253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:04.122253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:04.123339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:04.123339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:04.123339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:04.123339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:04.123339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:04.123339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:04.123339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:04.123339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:04.123339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:04.123339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:04.123339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:04.123339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:04.123339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:04.123339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:04.123339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:04.123339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:04.123339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:04.124389 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:04.124389 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:04.124389 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:04.124389 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 240/494] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:04.125572 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6266815-1dd9-4199-9873-3b6208faa2f4 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:04.172854 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:04.194450 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21141ab2-9617-48ae-854f-a8215c9a4e39 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:04.212828 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:04.226981 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a5e3e-71ee-46af-8f47-886734e5b0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:04.227594 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a5e3e-71ee-46af-8f47-886734e5b0dc None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:04.227917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a5e3e-71ee-46af-8f47-886734e5b0dc None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:04.228163 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a5e3e-71ee-46af-8f47-886734e5b0dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:04.228367 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6266815-1dd9-4199-9873-3b6208faa2f4 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:04.235745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a5e3e-71ee-46af-8f47-886734e5b0dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:04.237186 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a5e3e-71ee-46af-8f47-886734e5b0dc None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:04.250777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-c86a5e3e-71ee-46af-8f47-886734e5b0dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:47:04.250777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:04.250777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:04.250777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:04.250777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:04.250777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:04.250777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:04.250777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:04.250777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:04.250777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:04.250777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:04.250777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:04.250777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:47:04.250777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:47:04.250777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:47:04.250777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:47:04.251851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:04.251851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:04.251851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:47:04.251851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:04.251851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:47:04.251851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:04.251851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:04.251851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:04.251851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:04.251851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:04.251851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:04.251851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:04.251851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:04.251851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:04.251851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:04.251851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:04.251851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:04.251851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:04.252758 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:04.252758 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:04.252758 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:47:04.252758 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:47:04.252758 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:47:04.252758 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:47:04.252758 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:47:04.252758 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:47:04.252758 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:47:04.252758 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:04.252758 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 255/495] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Aug 17 14:47:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:04.253308 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a5e3e-71ee-46af-8f47-886734e5b0dc None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:04.267954 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d30c34-4b3a-412b-8107-121708c86efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:04.268571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d30c34-4b3a-412b-8107-121708c86efe None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:04.268844 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d30c34-4b3a-412b-8107-121708c86efe None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:04.269107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d30c34-4b3a-412b-8107-121708c86efe None admin] PATH_INFO: `/v3/users/glance` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:04.277181 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d30c34-4b3a-412b-8107-121708c86efe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:04.278627 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d30c34-4b3a-412b-8107-121708c86efe None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:04.290838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-d5d30c34-4b3a-412b-8107-121708c86efe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 14:47:04.290838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:04.290838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:04.290838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:04.290838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:04.290838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:04.290838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:04.290838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:04.290838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:04.290838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:04.290838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:04.290838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:04.290838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:47:04.290838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:47:04.290838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:47:04.290838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:47:04.291915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:04.291915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:04.291915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:47:04.291915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:04.291915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:47:04.291915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:04.291915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:04.291915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:04.291915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:04.291915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:04.291915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:04.291915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:04.291915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:04.291915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:04.291915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:04.291915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:04.291915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:04.291915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:04.293872 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:04.293872 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:04.293872 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:47:04.293872 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:47:04.293872 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:47:04.293872 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:47:04.293872 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:47:04.293872 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:47:04.293872 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 14:47:04.293872 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:04.293872 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 241/496] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:47:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:04.293872 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d30c34-4b3a-412b-8107-121708c86efe None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:04.365520 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a5e3e-71ee-46af-8f47-886734e5b0dc None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:04.398858 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f1d0c-144e-4c19-b3b2-2f79d8d818bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:04.399405 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f1d0c-144e-4c19-b3b2-2f79d8d818bb None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:04.399686 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f1d0c-144e-4c19-b3b2-2f79d8d818bb None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:04.399959 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f1d0c-144e-4c19-b3b2-2f79d8d818bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:04.404035 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d30c34-4b3a-412b-8107-121708c86efe None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:04.407340 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:04.412143 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f1d0c-144e-4c19-b3b2-2f79d8d818bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:47:04.417138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-eb5f1d0c-144e-4c19-b3b2-2f79d8d818bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:04.417138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:04.417138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:04.417138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:04.417138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:04.417138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:04.417138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:04.417138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:04.417138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:04.417138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:04.417138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:04.417138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:04.417138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:47:04.417138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:47:04.417138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:47:04.417138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:47:04.418673 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:47:04.418673 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:47:04.418673 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:47:04.418673 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:47:04.418673 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:04.418673 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:04.418673 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:04.418673 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:04.418673 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:04.418673 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:04.418673 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:04.418673 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:04.418673 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:04.418673 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:04.418673 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:04.418673 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:04.419733 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:04.419733 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:04.419733 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:04.419733 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:04.419733 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:47:04.419733 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:47:04.419733 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:47:04.419733 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:47:04.419733 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:47:04.419733 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:47:04.419733 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:04.419733 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:04.419733 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 256/497] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 17 14:47:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:04.420633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f1d0c-144e-4c19-b3b2-2f79d8d818bb None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:04.443615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1edfd98-fdb3-46f7-8516-d180affcf0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:04.444214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edfd98-fdb3-46f7-8516-d180affcf0c8 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:04.444481 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edfd98-fdb3-46f7-8516-d180affcf0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:04.444743 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edfd98-fdb3-46f7-8516-d180affcf0c8 None admin] PATH_INFO: `/v3/domains` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:04.445379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1edfd98-fdb3-46f7-8516-d180affcf0c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:04.445675 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1edfd98-fdb3-46f7-8516-d180affcf0c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:04.447072 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1edfd98-fdb3-46f7-8516-d180affcf0c8 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:04.458709 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 242/498] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:04.459324 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1edfd98-fdb3-46f7-8516-d180affcf0c8 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:04.469669 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:04.519333 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f1d0c-144e-4c19-b3b2-2f79d8d818bb None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:04.554128 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898620e-d35d-4f9a-b9bb-78961408137e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:04.554488 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898620e-d35d-4f9a-b9bb-78961408137e None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:04.554780 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898620e-d35d-4f9a-b9bb-78961408137e None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:04.555061 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898620e-d35d-4f9a-b9bb-78961408137e None admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:04.556093 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898620e-d35d-4f9a-b9bb-78961408137e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:04.556405 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898620e-d35d-4f9a-b9bb-78961408137e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:04.558038 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898620e-d35d-4f9a-b9bb-78961408137e None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:04.569794 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1edfd98-fdb3-46f7-8516-d180affcf0c8 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:04.595133 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 257/499] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Aug 17 14:47:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:04.595966 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898620e-d35d-4f9a-b9bb-78961408137e None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:04.609071 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b8a7e-0425-4d7f-bdda-d8db228954bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:04.609764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b8a7e-0425-4d7f-bdda-d8db228954bc None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:04.610053 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b8a7e-0425-4d7f-bdda-d8db228954bc None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:04.610290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b8a7e-0425-4d7f-bdda-d8db228954bc None admin] PATH_INFO: `/v3/users` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:04.611017 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b8a7e-0425-4d7f-bdda-d8db228954bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:04.611315 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b8a7e-0425-4d7f-bdda-d8db228954bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:04.612729 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b8a7e-0425-4d7f-bdda-d8db228954bc None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:04.653987 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 243/500] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Aug 17 14:47:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:04.653987 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b8a7e-0425-4d7f-bdda-d8db228954bc None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:04.656008 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:04.700598 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898620e-d35d-4f9a-b9bb-78961408137e None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:04.712974 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:04.734557 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b87af2-8c17-4e5e-9ec6-e07c76981d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:04.735158 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b87af2-8c17-4e5e-9ec6-e07c76981d61 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:04.735439 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b87af2-8c17-4e5e-9ec6-e07c76981d61 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:04.735713 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b87af2-8c17-4e5e-9ec6-e07c76981d61 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:04.736380 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b87af2-8c17-4e5e-9ec6-e07c76981d61 None admin] RBAC: Adding query filter params (name=service) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:04.736681 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b87af2-8c17-4e5e-9ec6-e07c76981d61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:04.738090 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b87af2-8c17-4e5e-9ec6-e07c76981d61 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:04.746605 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 258/501] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 17 14:47:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:04.747385 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b87af2-8c17-4e5e-9ec6-e07c76981d61 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:04.757431 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b8a7e-0425-4d7f-bdda-d8db228954bc None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:04.793976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584629a-518f-4487-b7e2-76bc788a6d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:04.794798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584629a-518f-4487-b7e2-76bc788a6d64 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:04.795222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584629a-518f-4487-b7e2-76bc788a6d64 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:04.795490 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584629a-518f-4487-b7e2-76bc788a6d64 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:04.802492 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584629a-518f-4487-b7e2-76bc788a6d64 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:04.803931 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584629a-518f-4487-b7e2-76bc788a6d64 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:04.815994 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-1584629a-518f-4487-b7e2-76bc788a6d64 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 14:47:04.815994 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:04.815994 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:04.815994 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:04.815994 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:04.815994 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:04.815994 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:04.815994 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:04.815994 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:04.815994 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:04.815994 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:04.815994 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:04.815994 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:47:04.815994 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:47:04.815994 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:47:04.815994 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:47:04.817090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:04.817090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:04.817090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:47:04.817090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:04.817090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:47:04.817090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:04.817090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:04.817090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:04.817090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:04.817090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:04.817090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:04.817090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:04.817090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:04.817090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:04.817090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:04.817090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:04.817090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:04.817090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:04.818016 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:04.818016 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:04.818016 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:47:04.818016 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:47:04.818016 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:47:04.818016 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:47:04.818016 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:47:04.818016 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:47:04.818016 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 14:47:04.818016 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:04.818016 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 244/502] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:47:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:04.818583 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584629a-518f-4487-b7e2-76bc788a6d64 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:04.846235 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b87af2-8c17-4e5e-9ec6-e07c76981d61 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:04.863581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:04.882799 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ac5ec-a908-45d3-9ddc-9e30aa492c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:04.883415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ac5ec-a908-45d3-9ddc-9e30aa492c39 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:04.883698 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ac5ec-a908-45d3-9ddc-9e30aa492c39 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:04.883972 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ac5ec-a908-45d3-9ddc-9e30aa492c39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:04.918616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584629a-518f-4487-b7e2-76bc788a6d64 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:04.941625 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:04.951574 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ac5ec-a908-45d3-9ddc-9e30aa492c39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:04.953029 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ac5ec-a908-45d3-9ddc-9e30aa492c39 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:04.953434 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1671ef3-0f8e-433c-8fe7-657ea0a9b072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:04.954056 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1671ef3-0f8e-433c-8fe7-657ea0a9b072 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:04.954337 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1671ef3-0f8e-433c-8fe7-657ea0a9b072 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:04.954614 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1671ef3-0f8e-433c-8fe7-657ea0a9b072 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:05.022469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1671ef3-0f8e-433c-8fe7-657ea0a9b072 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:05.023920 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1671ef3-0f8e-433c-8fe7-657ea0a9b072 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:05.049714 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 259/503] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:47:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:47:05.050757 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ac5ec-a908-45d3-9ddc-9e30aa492c39 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:05.071208 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:05.123819 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 245/504] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:47:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:47:05.124610 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1671ef3-0f8e-433c-8fe7-657ea0a9b072 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:05.151943 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:05.154269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ac5ec-a908-45d3-9ddc-9e30aa492c39 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:05.188684 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e85a8f-2a41-4555-aba6-fb15b2f0b164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:05.189229 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e85a8f-2a41-4555-aba6-fb15b2f0b164 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:05.189506 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e85a8f-2a41-4555-aba6-fb15b2f0b164 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:05.189874 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e85a8f-2a41-4555-aba6-fb15b2f0b164 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:05.199755 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e85a8f-2a41-4555-aba6-fb15b2f0b164 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:05.201195 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e85a8f-2a41-4555-aba6-fb15b2f0b164 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:05.216346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-58e85a8f-2a41-4555-aba6-fb15b2f0b164 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:05.216346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:05.216346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:05.216346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:05.216346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:05.216346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:05.216346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:05.216346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:05.216346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:05.216346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:05.216346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:05.216346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:05.216346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:05.216346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:05.216346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:05.216346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:05.217406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:05.217406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:05.217406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:05.217406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:05.217406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:05.217406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:05.217406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:05.217406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:05.217406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:05.217406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:05.217406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:05.217406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:05.217406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:05.217406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:05.217406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:05.217406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:05.217406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:05.218496 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:05.218496 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:05.218496 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:05.218496 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 260/505] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:05.218496 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e85a8f-2a41-4555-aba6-fb15b2f0b164 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:05.230328 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1671ef3-0f8e-433c-8fe7-657ea0a9b072 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:05.265389 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ce4ca-361f-4b96-8657-b4e838121a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:05.266004 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ce4ca-361f-4b96-8657-b4e838121a9c None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:05.266279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ce4ca-361f-4b96-8657-b4e838121a9c None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:05.266545 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ce4ca-361f-4b96-8657-b4e838121a9c None admin] PATH_INFO: `/v3/users` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:05.267261 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ce4ca-361f-4b96-8657-b4e838121a9c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:05.267562 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ce4ca-361f-4b96-8657-b4e838121a9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:05.268966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ce4ca-361f-4b96-8657-b4e838121a9c None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:05.285589 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 246/506] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Aug 17 14:47:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:05.286257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ce4ca-361f-4b96-8657-b4e838121a9c None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:05.289481 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:05.321072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e85a8f-2a41-4555-aba6-fb15b2f0b164 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:05.354032 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec84f8-355d-4028-bed1-dcc134575708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:05.355312 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec84f8-355d-4028-bed1-dcc134575708 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:05.355693 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec84f8-355d-4028-bed1-dcc134575708 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:05.355897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec84f8-355d-4028-bed1-dcc134575708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:05.366284 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec84f8-355d-4028-bed1-dcc134575708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:05.367706 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec84f8-355d-4028-bed1-dcc134575708 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:05.370153 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:05.382254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-e4ec84f8-355d-4028-bed1-dcc134575708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:05.382254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:05.382254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:05.382254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:05.382254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:05.382254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:05.382254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:05.382254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:05.382254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:05.382254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:05.382254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:05.382254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:05.382254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:05.382254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:05.382254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:05.382254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:05.383201 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:05.383201 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:05.383201 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:05.383201 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:05.383201 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:05.383201 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:05.383201 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:05.383201 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:05.383201 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:05.383201 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:05.383201 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:05.383201 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:05.383201 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:05.383201 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:05.383201 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:05.383201 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:05.383201 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:05.384077 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:05.384077 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:05.384077 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:05.384077 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 261/507] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:05.384077 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec84f8-355d-4028-bed1-dcc134575708 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:05.391463 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ce4ca-361f-4b96-8657-b4e838121a9c None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:05.425812 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41b66e-f619-4cef-a7df-f00bf08fe5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:05.426429 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41b66e-f619-4cef-a7df-f00bf08fe5f7 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:05.426703 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41b66e-f619-4cef-a7df-f00bf08fe5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:05.426974 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41b66e-f619-4cef-a7df-f00bf08fe5f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:05.436990 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41b66e-f619-4cef-a7df-f00bf08fe5f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:05.438457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41b66e-f619-4cef-a7df-f00bf08fe5f7 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:05.453686 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-1d41b66e-f619-4cef-a7df-f00bf08fe5f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:05.453686 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:05.453686 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:05.453686 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:05.453686 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:05.453686 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:05.453686 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:05.453686 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:05.453686 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:05.453686 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:05.453686 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:05.453686 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:05.453686 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:05.453686 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:05.453686 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:05.453686 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:05.454571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:05.454571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:05.454571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:05.454571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:05.454571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:05.454571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:05.454571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:05.454571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:05.454571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:05.454571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:05.454571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:05.454571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:05.454571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:05.454571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:05.454571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:05.454571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:05.454571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:05.455428 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:05.455428 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:05.455428 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:05.455428 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 247/508] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:05.456595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41b66e-f619-4cef-a7df-f00bf08fe5f7 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:05.483331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec84f8-355d-4028-bed1-dcc134575708 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:05.504504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:05.518629 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1a266-ae2b-4e84-a67f-9f89b0a67b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:05.519228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1a266-ae2b-4e84-a67f-9f89b0a67b87 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:05.519503 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1a266-ae2b-4e84-a67f-9f89b0a67b87 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:05.519770 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1a266-ae2b-4e84-a67f-9f89b0a67b87 None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:05.520412 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1a266-ae2b-4e84-a67f-9f89b0a67b87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:05.520708 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1a266-ae2b-4e84-a67f-9f89b0a67b87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:05.522110 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1a266-ae2b-4e84-a67f-9f89b0a67b87 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:05.534519 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 262/509] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:05.535511 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1a266-ae2b-4e84-a67f-9f89b0a67b87 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:05.567897 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41b66e-f619-4cef-a7df-f00bf08fe5f7 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:05.602281 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b7352-079a-414a-b439-0167802d06d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:05.602877 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b7352-079a-414a-b439-0167802d06d0 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:05.603154 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b7352-079a-414a-b439-0167802d06d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:05.603816 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b7352-079a-414a-b439-0167802d06d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:05.606883 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:05.636820 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1a266-ae2b-4e84-a67f-9f89b0a67b87 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:05.670543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a82fa-1ca8-4cdf-8d50-9de338879e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:05.671143 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a82fa-1ca8-4cdf-8d50-9de338879e6b None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:05.671421 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a82fa-1ca8-4cdf-8d50-9de338879e6b None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:05.671693 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a82fa-1ca8-4cdf-8d50-9de338879e6b None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:05.672328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a82fa-1ca8-4cdf-8d50-9de338879e6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:05.672631 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a82fa-1ca8-4cdf-8d50-9de338879e6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:05.673496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b7352-079a-414a-b439-0167802d06d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:05.674032 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a82fa-1ca8-4cdf-8d50-9de338879e6b None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:05.674995 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b7352-079a-414a-b439-0167802d06d0 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:05.684865 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 263/510] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:05.685654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a82fa-1ca8-4cdf-8d50-9de338879e6b None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:05.728125 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:05.779684 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 248/511] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:47:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:47:05.780684 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b7352-079a-414a-b439-0167802d06d0 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:05.785933 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a82fa-1ca8-4cdf-8d50-9de338879e6b None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:05.815338 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:05.819358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d1d61-25c4-44bc-94f8-94c69ddb34bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:05.819951 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d1d61-25c4-44bc-94f8-94c69ddb34bb None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:05.820225 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d1d61-25c4-44bc-94f8-94c69ddb34bb None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:05.820490 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d1d61-25c4-44bc-94f8-94c69ddb34bb None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:05.821122 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d1d61-25c4-44bc-94f8-94c69ddb34bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:05.821416 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d1d61-25c4-44bc-94f8-94c69ddb34bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:05.822811 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d1d61-25c4-44bc-94f8-94c69ddb34bb None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:05.834512 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 264/512] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:05.835292 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d1d61-25c4-44bc-94f8-94c69ddb34bb None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:05.887206 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b7352-079a-414a-b439-0167802d06d0 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:05.921637 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e4326-b45e-45ca-ba7b-fd460dd17ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:05.922394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e4326-b45e-45ca-ba7b-fd460dd17ef2 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:05.922670 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e4326-b45e-45ca-ba7b-fd460dd17ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:05.922938 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e4326-b45e-45ca-ba7b-fd460dd17ef2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:05.929712 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e4326-b45e-45ca-ba7b-fd460dd17ef2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:05.931243 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e4326-b45e-45ca-ba7b-fd460dd17ef2 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:05.933587 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d1d61-25c4-44bc-94f8-94c69ddb34bb None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:05.935128 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:05.942876 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-697e4326-b45e-45ca-ba7b-fd460dd17ef2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 14:47:05.942876 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:05.942876 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:05.942876 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:05.942876 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:05.942876 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:05.942876 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:05.942876 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:05.942876 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:05.942876 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:05.942876 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:05.942876 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:05.942876 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:47:05.942876 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:47:05.942876 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:47:05.942876 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:47:05.943808 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:05.943808 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:05.943808 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:47:05.943808 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:05.943808 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:47:05.943808 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:05.943808 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:05.943808 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:05.943808 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:05.943808 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:05.943808 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:05.943808 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:05.943808 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:05.943808 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:05.943808 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:05.943808 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:05.943808 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:05.943808 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:05.944685 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:05.944685 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:05.944685 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:47:05.944685 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:47:05.944685 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:47:05.944685 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:47:05.944685 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:47:05.944685 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:47:05.944685 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 14:47:05.944685 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:05.944685 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 249/513] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 17 14:47:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:05.945268 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e4326-b45e-45ca-ba7b-fd460dd17ef2 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:05.971323 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d060f-b74a-4da4-9be5-c189fd2df666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:05.971944 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d060f-b74a-4da4-9be5-c189fd2df666 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:05.972225 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d060f-b74a-4da4-9be5-c189fd2df666 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:05.972497 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d060f-b74a-4da4-9be5-c189fd2df666 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:05.979212 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d060f-b74a-4da4-9be5-c189fd2df666 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:05.981344 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d060f-b74a-4da4-9be5-c189fd2df666 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:05.993022 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-916d060f-b74a-4da4-9be5-c189fd2df666 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:05.993022 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:05.993022 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:05.993022 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:05.993022 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:05.993022 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:05.993022 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:05.993022 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:05.993022 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:05.993022 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:05.993022 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:05.993022 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:05.993022 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:47:05.993022 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:47:05.993022 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:47:05.993924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:47:05.993924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:05.993924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:05.993924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:05.993924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:05.993924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:05.993924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:05.993924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:05.993924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:05.993924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:05.993924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:05.993924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:05.993924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:05.993924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:05.993924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:05.993924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:05.993924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:05.995057 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:47:05.995057 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:47:05.995057 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:47:05.995057 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:47:05.995057 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:47:05.995057 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:47:05.995057 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:05.995057 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:05.995057 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 265/514] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:05.995992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d060f-b74a-4da4-9be5-c189fd2df666 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:06.040184 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:06.048375 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e4326-b45e-45ca-ba7b-fd460dd17ef2 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:06.081108 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b414d-d792-4d64-b42e-eb5dd8ea1964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:06.081722 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b414d-d792-4d64-b42e-eb5dd8ea1964 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:06.082024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b414d-d792-4d64-b42e-eb5dd8ea1964 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:06.082296 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b414d-d792-4d64-b42e-eb5dd8ea1964 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:06.093048 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b414d-d792-4d64-b42e-eb5dd8ea1964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:06.094298 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d060f-b74a-4da4-9be5-c189fd2df666 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:06.094526 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b414d-d792-4d64-b42e-eb5dd8ea1964 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:06.109043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-562b414d-d792-4d64-b42e-eb5dd8ea1964 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:06.109043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:06.109043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:06.109043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:06.109043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:06.109043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:06.109043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:06.109043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:06.109043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:06.109043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:06.109043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:06.109043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:06.109043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:06.109043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:06.109043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:06.109043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:06.110003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:06.110003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:06.110003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:06.110003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:06.110003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:06.110003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:06.110003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:06.110003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:06.110003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:06.110003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:06.110003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:06.110003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:06.110003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:06.110003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:06.110003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:06.110003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:06.110003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:06.111303 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:06.111303 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:06.111303 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:06.111303 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 250/515] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:06.111303 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b414d-d792-4d64-b42e-eb5dd8ea1964 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:06.132640 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5452a36-a695-4a15-8e3b-24cf603761c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:06.133252 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5452a36-a695-4a15-8e3b-24cf603761c3 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:06.133539 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5452a36-a695-4a15-8e3b-24cf603761c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:06.133838 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5452a36-a695-4a15-8e3b-24cf603761c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:06.140822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5452a36-a695-4a15-8e3b-24cf603761c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:06.142284 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5452a36-a695-4a15-8e3b-24cf603761c3 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:06.153718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-a5452a36-a695-4a15-8e3b-24cf603761c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:06.153718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:06.153718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:06.153718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:06.153718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:06.153718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:06.153718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:06.153718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:06.153718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:06.153718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:06.153718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:06.153718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:06.153718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:47:06.153718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:47:06.153718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:47:06.154752 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:47:06.154752 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:06.154752 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:06.154752 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:06.154752 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:06.154752 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:06.154752 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:06.154752 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:06.154752 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:06.154752 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:06.154752 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:06.154752 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:06.154752 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:06.154752 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:06.154752 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:06.154752 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:06.154752 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:06.155612 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:47:06.155612 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:47:06.155612 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:47:06.155612 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:47:06.155612 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:47:06.155612 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:47:06.155612 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:06.155612 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:06.155612 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 266/516] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:06.156064 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5452a36-a695-4a15-8e3b-24cf603761c3 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:06.183035 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:06.218359 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b414d-d792-4d64-b42e-eb5dd8ea1964 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:06.254718 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa5d5d-aa70-46a1-9524-e9da28cd2266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:06.255234 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa5d5d-aa70-46a1-9524-e9da28cd2266 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:06.255507 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa5d5d-aa70-46a1-9524-e9da28cd2266 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:06.255775 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa5d5d-aa70-46a1-9524-e9da28cd2266 None admin] PATH_INFO: `/v3/users` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:06.256489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa5d5d-aa70-46a1-9524-e9da28cd2266 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:06.256786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa5d5d-aa70-46a1-9524-e9da28cd2266 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:06.258251 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa5d5d-aa70-46a1-9524-e9da28cd2266 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:06.259689 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5452a36-a695-4a15-8e3b-24cf603761c3 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:06.275349 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 251/517] 10.222.0.30 () {56 vars in 1139 bytes} [Wed Aug 17 14:47:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:06.276999 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa5d5d-aa70-46a1-9524-e9da28cd2266 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:06.284304 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:06.294356 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ebbb2-8ceb-48c9-bc1b-4c862ad09847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:06.294961 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ebbb2-8ceb-48c9-bc1b-4c862ad09847 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:06.295243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ebbb2-8ceb-48c9-bc1b-4c862ad09847 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:06.295515 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ebbb2-8ceb-48c9-bc1b-4c862ad09847 None admin] PATH_INFO: `/v3/projects` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:06.296212 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ebbb2-8ceb-48c9-bc1b-4c862ad09847 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:06.296516 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ebbb2-8ceb-48c9-bc1b-4c862ad09847 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:06.297960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ebbb2-8ceb-48c9-bc1b-4c862ad09847 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:06.316774 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 267/518] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:47:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:06.317605 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ebbb2-8ceb-48c9-bc1b-4c862ad09847 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:06.395923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa5d5d-aa70-46a1-9524-e9da28cd2266 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:06.416348 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:06.437017 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ebbb2-8ceb-48c9-bc1b-4c862ad09847 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:06.439978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe48939-7766-4687-ad1f-574099589b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:06.440587 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe48939-7766-4687-ad1f-574099589b3e None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:06.440864 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe48939-7766-4687-ad1f-574099589b3e None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:06.441134 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe48939-7766-4687-ad1f-574099589b3e None admin] PATH_INFO: `/v3/domains` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:06.441818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe48939-7766-4687-ad1f-574099589b3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:06.442119 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe48939-7766-4687-ad1f-574099589b3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:06.443507 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe48939-7766-4687-ad1f-574099589b3e None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:06.458174 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 252/519] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:06.458871 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe48939-7766-4687-ad1f-574099589b3e None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:06.480614 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5266b8-6e8f-4dbc-b0fb-54614cc5f28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:06.481216 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5266b8-6e8f-4dbc-b0fb-54614cc5f28d None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:06.481495 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5266b8-6e8f-4dbc-b0fb-54614cc5f28d None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:06.481795 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5266b8-6e8f-4dbc-b0fb-54614cc5f28d None admin] PATH_INFO: `/v3/projects` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:06.482499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5266b8-6e8f-4dbc-b0fb-54614cc5f28d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:06.482806 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5266b8-6e8f-4dbc-b0fb-54614cc5f28d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:06.484244 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5266b8-6e8f-4dbc-b0fb-54614cc5f28d None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:06.497552 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 268/520] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:47:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:06.498418 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5266b8-6e8f-4dbc-b0fb-54614cc5f28d None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:06.537186 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:06.581246 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe48939-7766-4687-ad1f-574099589b3e None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:06.622285 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262dae7-fcdf-431f-8d47-f946c0c6d65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:06.622285 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262dae7-fcdf-431f-8d47-f946c0c6d65f None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:06.622604 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262dae7-fcdf-431f-8d47-f946c0c6d65f None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:06.622805 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262dae7-fcdf-431f-8d47-f946c0c6d65f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:06.622950 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5266b8-6e8f-4dbc-b0fb-54614cc5f28d None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:06.665765 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62a12d-7a5b-47bf-ac27-3f9f58efd3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:06.666375 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62a12d-7a5b-47bf-ac27-3f9f58efd3bd None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:06.666656 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62a12d-7a5b-47bf-ac27-3f9f58efd3bd None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:06.667001 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62a12d-7a5b-47bf-ac27-3f9f58efd3bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:06.667971 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62a12d-7a5b-47bf-ac27-3f9f58efd3bd None admin] RBAC: Adding query filter params (role.id=cb99a767f5264f2dace0994d13d0fbc8, scope.project.id=e9d40280440c4d25b6d60a431d6f788b, user.id=8aca6a001d3b479bab684772768d49f5) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:06.668281 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62a12d-7a5b-47bf-ac27-3f9f58efd3bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:06.669769 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62a12d-7a5b-47bf-ac27-3f9f58efd3bd None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:06.675490 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 269/521] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:47:06 2022] GET /identity/v3/role_assignments?user.id=8aca6a001d3b479bab684772768d49f5&scope.project.id=e9d40280440c4d25b6d60a431d6f788b&role.id=cb99a767f5264f2dace0994d13d0fbc8 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:06.676379 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62a12d-7a5b-47bf-ac27-3f9f58efd3bd None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:06.689637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:06.714842 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262dae7-fcdf-431f-8d47-f946c0c6d65f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:06.716477 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262dae7-fcdf-431f-8d47-f946c0c6d65f None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:06.792221 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:06.803706 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62a12d-7a5b-47bf-ac27-3f9f58efd3bd None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:06.847908 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 253/522] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:47:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:47:06.847908 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262dae7-fcdf-431f-8d47-f946c0c6d65f None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:06.851185 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d928d25-7ed3-4c9a-adfc-b3589b40d319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:06.852075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d928d25-7ed3-4c9a-adfc-b3589b40d319 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:06.852500 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d928d25-7ed3-4c9a-adfc-b3589b40d319 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:06.852914 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d928d25-7ed3-4c9a-adfc-b3589b40d319 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:06.863077 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d928d25-7ed3-4c9a-adfc-b3589b40d319 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:06.864803 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d928d25-7ed3-4c9a-adfc-b3589b40d319 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:06.878965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-7d928d25-7ed3-4c9a-adfc-b3589b40d319 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:06.878965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:06.878965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:06.878965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:06.878965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:06.878965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:06.878965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:06.878965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:06.878965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:06.878965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:06.878965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:06.878965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:06.878965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:47:06.878965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:47:06.878965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:47:06.880071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:47:06.880071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:06.880071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:06.880071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:06.880071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:06.880071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:06.880071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:06.880071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:06.880071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:06.880071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:06.880071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:06.880071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:06.880071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:06.880071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:06.880071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:06.880071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:06.880071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:06.881134 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:47:06.881134 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:47:06.881134 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:47:06.881134 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:47:06.881134 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:47:06.881134 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:47:06.881134 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:06.881134 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:06.882919 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 270/523] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:06.883929 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d928d25-7ed3-4c9a-adfc-b3589b40d319 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:06.975153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:06.992982 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262dae7-fcdf-431f-8d47-f946c0c6d65f None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:07.019215 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d928d25-7ed3-4c9a-adfc-b3589b40d319 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:07.038814 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df557c93-4694-4858-9229-980c9c2bef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:07.039475 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df557c93-4694-4858-9229-980c9c2bef6d None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:07.039779 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df557c93-4694-4858-9229-980c9c2bef6d None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:07.040055 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df557c93-4694-4858-9229-980c9c2bef6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:07.041052 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df557c93-4694-4858-9229-980c9c2bef6d None admin] RBAC: Adding query filter params (role.id=cb99a767f5264f2dace0994d13d0fbc8, scope.project.id=e9d40280440c4d25b6d60a431d6f788b, user.id=272278199c5149a1ad326f22ef11f4e1) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:07.041615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df557c93-4694-4858-9229-980c9c2bef6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:07.044936 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df557c93-4694-4858-9229-980c9c2bef6d None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:07.061763 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 254/524] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:47:06 2022] GET /identity/v3/role_assignments?user.id=272278199c5149a1ad326f22ef11f4e1&scope.project.id=e9d40280440c4d25b6d60a431d6f788b&role.id=cb99a767f5264f2dace0994d13d0fbc8 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:07.061763 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df557c93-4694-4858-9229-980c9c2bef6d None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:07.076245 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1bc43-a978-40b1-82f3-b69d9e3657c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:07.077023 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1bc43-a978-40b1-82f3-b69d9e3657c9 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:07.077342 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1bc43-a978-40b1-82f3-b69d9e3657c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:07.077685 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1bc43-a978-40b1-82f3-b69d9e3657c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:07.094140 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1bc43-a978-40b1-82f3-b69d9e3657c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:07.095844 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1bc43-a978-40b1-82f3-b69d9e3657c9 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:07.106893 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:07.122020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-b7b1bc43-a978-40b1-82f3-b69d9e3657c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:07.122020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:07.122020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:07.122020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:07.122020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:07.122020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:07.122020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:07.122020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:07.122020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:07.122020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:07.122020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:07.122020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:07.122020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:07.122020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:07.122020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:07.122020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:07.123846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:07.123846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:07.123846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:07.123846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:07.123846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:07.123846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:07.123846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:07.123846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:07.123846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:07.123846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:07.123846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:07.123846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:07.123846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:07.123846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:07.123846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:07.123846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:07.123846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:07.124720 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:07.124720 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:07.124720 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:07.127104 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 271/525] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:07.141870 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1bc43-a978-40b1-82f3-b69d9e3657c9 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:07.213713 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df557c93-4694-4858-9229-980c9c2bef6d None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:07.258895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e6b7e-fcef-4a4c-ab29-3106cf89ec6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:07.259555 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e6b7e-fcef-4a4c-ab29-3106cf89ec6e None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:07.259962 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e6b7e-fcef-4a4c-ab29-3106cf89ec6e None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:07.260251 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e6b7e-fcef-4a4c-ab29-3106cf89ec6e None admin] PATH_INFO: `/v3/projects` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:07.261006 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e6b7e-fcef-4a4c-ab29-3106cf89ec6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:07.261343 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e6b7e-fcef-4a4c-ab29-3106cf89ec6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:07.263172 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e6b7e-fcef-4a4c-ab29-3106cf89ec6e None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:07.289958 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 255/526] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:47:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:07.292722 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e6b7e-fcef-4a4c-ab29-3106cf89ec6e None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:07.298706 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1bc43-a978-40b1-82f3-b69d9e3657c9 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:07.318008 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:07.337936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447fd0d-f62a-49b9-9817-a3a936830aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:07.339446 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447fd0d-f62a-49b9-9817-a3a936830aa7 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:07.340028 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447fd0d-f62a-49b9-9817-a3a936830aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:07.340620 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447fd0d-f62a-49b9-9817-a3a936830aa7 None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:07.342003 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447fd0d-f62a-49b9-9817-a3a936830aa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:07.342485 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447fd0d-f62a-49b9-9817-a3a936830aa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:07.344160 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447fd0d-f62a-49b9-9817-a3a936830aa7 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:07.359163 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 272/527] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:07.365190 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447fd0d-f62a-49b9-9817-a3a936830aa7 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:07.395648 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:07.410823 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e6b7e-fcef-4a4c-ab29-3106cf89ec6e None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:07.449608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e660c-5e58-4dc2-a5f5-2c507759dc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:07.450578 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e660c-5e58-4dc2-a5f5-2c507759dc71 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:07.451051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e660c-5e58-4dc2-a5f5-2c507759dc71 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:07.451463 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e660c-5e58-4dc2-a5f5-2c507759dc71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:07.452476 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e660c-5e58-4dc2-a5f5-2c507759dc71 None admin] RBAC: Adding query filter params (role.id=cb99a767f5264f2dace0994d13d0fbc8, scope.project.id=e9d40280440c4d25b6d60a431d6f788b, user.id=1dacf10fc91547788a9f8bbedfa0f553) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:07.453076 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e660c-5e58-4dc2-a5f5-2c507759dc71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:07.454786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e660c-5e58-4dc2-a5f5-2c507759dc71 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:07.470193 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 256/528] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:47:07 2022] GET /identity/v3/role_assignments?user.id=1dacf10fc91547788a9f8bbedfa0f553&scope.project.id=e9d40280440c4d25b6d60a431d6f788b&role.id=cb99a767f5264f2dace0994d13d0fbc8 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:07.472936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447fd0d-f62a-49b9-9817-a3a936830aa7 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:07.514111 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe252abe-ac4b-4621-b265-52a55def8d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:07.514753 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe252abe-ac4b-4621-b265-52a55def8d92 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:07.515033 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe252abe-ac4b-4621-b265-52a55def8d92 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:07.515302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe252abe-ac4b-4621-b265-52a55def8d92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:07.523476 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe252abe-ac4b-4621-b265-52a55def8d92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:07.525039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe252abe-ac4b-4621-b265-52a55def8d92 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:07.539147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-fe252abe-ac4b-4621-b265-52a55def8d92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:07.539147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:07.539147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:07.539147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:07.539147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:07.539147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:07.539147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:07.539147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:07.539147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:07.539147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:07.539147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:07.539147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:07.539147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:47:07.539147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:47:07.539147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:47:07.540266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:47:07.540266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:07.540266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:07.540266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:07.540266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:07.540266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:07.540266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:07.540266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:07.540266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:07.540266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:07.540266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:07.540266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:07.540266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:07.540266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:07.540266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:07.540266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:07.540266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:07.541466 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:47:07.541466 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:47:07.541466 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:47:07.541466 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:47:07.541466 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:47:07.541466 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:47:07.541466 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:07.541466 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:07.541466 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 273/529] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:07.549020 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e660c-5e58-4dc2-a5f5-2c507759dc71 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:07.671098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e660c-5e58-4dc2-a5f5-2c507759dc71 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:07.708211 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969064c-8f46-48c5-89b0-7d8d99e25fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:07.708807 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969064c-8f46-48c5-89b0-7d8d99e25fcc None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:07.709082 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969064c-8f46-48c5-89b0-7d8d99e25fcc None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:07.709352 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969064c-8f46-48c5-89b0-7d8d99e25fcc None admin] PATH_INFO: `/v3/projects` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:07.710071 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969064c-8f46-48c5-89b0-7d8d99e25fcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:07.710421 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969064c-8f46-48c5-89b0-7d8d99e25fcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:07.711846 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969064c-8f46-48c5-89b0-7d8d99e25fcc None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:07.725090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 257/530] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:47:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:07.731604 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe252abe-ac4b-4621-b265-52a55def8d92 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:07.782154 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:07.842915 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe252abe-ac4b-4621-b265-52a55def8d92 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:07.879913 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfdb87-5b88-484a-ad1b-32ee06464827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:07.880783 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfdb87-5b88-484a-ad1b-32ee06464827 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:07.881303 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfdb87-5b88-484a-ad1b-32ee06464827 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:07.881717 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfdb87-5b88-484a-ad1b-32ee06464827 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:07.882665 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfdb87-5b88-484a-ad1b-32ee06464827 None admin] RBAC: Adding query filter params (role.id=cb99a767f5264f2dace0994d13d0fbc8, scope.project.id=e9d40280440c4d25b6d60a431d6f788b, user.id=1e4147647f54499ba24b50fbecc5d38f) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:07.883114 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfdb87-5b88-484a-ad1b-32ee06464827 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:07.884775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfdb87-5b88-484a-ad1b-32ee06464827 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:07.891489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 274/531] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:47:07 2022] GET /identity/v3/role_assignments?user.id=1e4147647f54499ba24b50fbecc5d38f&scope.project.id=e9d40280440c4d25b6d60a431d6f788b&role.id=cb99a767f5264f2dace0994d13d0fbc8 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:09.133598 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbee9b-f36f-406b-90a2-13f233b79bad None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:09.134179 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbee9b-f36f-406b-90a2-13f233b79bad None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:09.134179 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbee9b-f36f-406b-90a2-13f233b79bad None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:09.136540 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 258/532] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:09.142391 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb1c39-c54e-47d8-a676-d05f3a107c47 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:09.143340 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb1c39-c54e-47d8-a676-d05f3a107c47 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:09.143849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb1c39-c54e-47d8-a676-d05f3a107c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:09.165125 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-b6fb1c39-c54e-47d8-a676-d05f3a107c47 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:09.166776 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-b6fb1c39-c54e-47d8-a676-d05f3a107c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:09.238804 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 275/533] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:47:09.307589 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68f74a-b3dc-4961-9847-46a952179a98 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:09.307908 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68f74a-b3dc-4961-9847-46a952179a98 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:09.308172 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68f74a-b3dc-4961-9847-46a952179a98 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:09.309782 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 259/534] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:47:09.315141 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7204a91-fd74-4ecf-a42e-b0e03c434b4b None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:09.315631 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7204a91-fd74-4ecf-a42e-b0e03c434b4b None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:09.316126 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7204a91-fd74-4ecf-a42e-b0e03c434b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:09.335449 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-e7204a91-fd74-4ecf-a42e-b0e03c434b4b None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:09.336974 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-e7204a91-fd74-4ecf-a42e-b0e03c434b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:09.366060 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:09.409978 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 276/535] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:47:09.595871 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68f74a-b3dc-4961-9847-46a952179a98 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:09.614011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:09.715362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68f74a-b3dc-4961-9847-46a952179a98 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:09.737502 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7204a91-fd74-4ecf-a42e-b0e03c434b4b None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:09.753685 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef49ad-3e88-4824-922a-60c99bdc9be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:09.754343 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef49ad-3e88-4824-922a-60c99bdc9be9 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:09.754619 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef49ad-3e88-4824-922a-60c99bdc9be9 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:09.754889 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef49ad-3e88-4824-922a-60c99bdc9be9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:09.766857 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef49ad-3e88-4824-922a-60c99bdc9be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:47:09.771646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-f7ef49ad-3e88-4824-922a-60c99bdc9be9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:09.771646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:09.771646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:09.771646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:09.771646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:09.771646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:09.771646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:09.771646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:09.771646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:09.771646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:09.771646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:09.771646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:09.771646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:47:09.771646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:47:09.771646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:47:09.771646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:47:09.772556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:47:09.772556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:47:09.772556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:47:09.772556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:47:09.772556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:09.772556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:09.772556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:09.772556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:09.772556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:09.772556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:09.772556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:09.772556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:09.772556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:09.772556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:09.772556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:09.772556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:09.773371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:09.773371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:09.773371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:09.773371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:09.773371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:47:09.773371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:47:09.773371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:47:09.773371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:47:09.773371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:47:09.773371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:47:09.773371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:09.773371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:09.773371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 260/536] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 17 14:47:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:09.774067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e213b07-aa81-4416-a321-ed0cedc554bc None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:09.774618 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e213b07-aa81-4416-a321-ed0cedc554bc None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:09.774618 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e213b07-aa81-4416-a321-ed0cedc554bc None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:09.775783 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 261/537] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:09.781136 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e213b07-aa81-4416-a321-ed0cedc554bc None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:09.863991 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:09.864852 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7204a91-fd74-4ecf-a42e-b0e03c434b4b None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:09.897159 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e213b07-aa81-4416-a321-ed0cedc554bc None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:09.906406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc5a84-19ea-4abb-a27a-769ad53cf351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:09.907037 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc5a84-19ea-4abb-a27a-769ad53cf351 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:09.907316 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc5a84-19ea-4abb-a27a-769ad53cf351 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:09.907584 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc5a84-19ea-4abb-a27a-769ad53cf351 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:09.918677 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc5a84-19ea-4abb-a27a-769ad53cf351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:47:09.923358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-37cc5a84-19ea-4abb-a27a-769ad53cf351 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:09.923358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:09.923358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:09.923358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:09.923358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:09.923358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:09.923358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:09.923358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:09.923358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:09.923358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:09.923358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:09.923358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:09.923358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:47:09.923358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:47:09.923358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:47:09.923358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:47:09.924265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:47:09.924265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:47:09.924265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:47:09.924265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:47:09.924265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:09.924265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:09.924265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:09.924265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:09.924265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:09.924265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:09.924265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:09.924265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:09.924265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:09.924265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:09.924265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:09.924265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:09.925047 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:09.925047 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:09.925047 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:09.925047 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:09.925047 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:47:09.925047 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:47:09.925047 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:47:09.925047 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:47:09.925047 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:47:09.925047 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:47:09.925047 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:09.925047 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:09.929358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 277/538] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 17 14:47:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:47:09.930476 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ac83f-3270-47ee-8b79-18c4e4c67fb5 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:09.930761 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ac83f-3270-47ee-8b79-18c4e4c67fb5 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:09.931045 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ac83f-3270-47ee-8b79-18c4e4c67fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:09.936515 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3375baa-28a1-46b5-b9b5-01550d63afcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:09.937119 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3375baa-28a1-46b5-b9b5-01550d63afcf None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:09.937394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3375baa-28a1-46b5-b9b5-01550d63afcf None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:09.937710 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3375baa-28a1-46b5-b9b5-01550d63afcf None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:09.938354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3375baa-28a1-46b5-b9b5-01550d63afcf None admin] RBAC: Adding query filter params (name=service) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:09.939344 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3375baa-28a1-46b5-b9b5-01550d63afcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:09.940000 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3375baa-28a1-46b5-b9b5-01550d63afcf None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:09.954155 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-d95ac83f-3270-47ee-8b79-18c4e4c67fb5 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:09.954327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 262/539] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 17 14:47:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:09.954327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3375baa-28a1-46b5-b9b5-01550d63afcf None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:09.954478 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-d95ac83f-3270-47ee-8b79-18c4e4c67fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:09.973054 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:10.036645 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 278/540] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:47:10.037845 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ac83f-3270-47ee-8b79-18c4e4c67fb5 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:10.102776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3375baa-28a1-46b5-b9b5-01550d63afcf None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:10.159137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d5deb-75a7-40fc-a640-bd86fbc8d8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:10.160102 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5deb-75a7-40fc-a640-bd86fbc8d8b5 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:10.160487 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5deb-75a7-40fc-a640-bd86fbc8d8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:10.160902 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5deb-75a7-40fc-a640-bd86fbc8d8b5 None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:10.161762 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d5deb-75a7-40fc-a640-bd86fbc8d8b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:10.162276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d5deb-75a7-40fc-a640-bd86fbc8d8b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:10.163946 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d5deb-75a7-40fc-a640-bd86fbc8d8b5 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:10.165559 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:10.179419 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 263/541] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 17 14:47:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:10.182157 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905a930-bbb2-47d6-92f1-dc3a21295bf4 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:10.183157 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905a930-bbb2-47d6-92f1-dc3a21295bf4 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:10.183967 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905a930-bbb2-47d6-92f1-dc3a21295bf4 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:10.186853 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 264/542] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:10.190328 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905a930-bbb2-47d6-92f1-dc3a21295bf4 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:10.212539 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ac83f-3270-47ee-8b79-18c4e4c67fb5 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:10.249261 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54d167-b17b-4ffa-ba60-0df64c37dca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:10.250129 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54d167-b17b-4ffa-ba60-0df64c37dca5 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:10.250459 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54d167-b17b-4ffa-ba60-0df64c37dca5 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:10.250742 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54d167-b17b-4ffa-ba60-0df64c37dca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:10.262857 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54d167-b17b-4ffa-ba60-0df64c37dca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:10.264133 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54d167-b17b-4ffa-ba60-0df64c37dca5 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:10.278457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-dc54d167-b17b-4ffa-ba60-0df64c37dca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:10.278457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:10.278457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:10.278457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:10.278457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:10.278457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:10.278457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:10.278457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:10.278457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:10.278457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:10.278457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:10.278457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:10.278457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:10.278457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:10.278457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:10.278457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:10.279373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:10.279373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:10.279373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:10.279373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:10.279373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:10.279373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:10.279373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:10.279373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:10.279373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:10.279373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:10.279373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:10.279373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:10.279373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:10.279373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:10.279373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:10.279373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:10.279373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:10.280336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:10.280336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:10.280336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:10.280336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 279/543] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:10.280987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9e66c-7199-489d-a10b-cd71c84b8e14 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:10.280987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9e66c-7199-489d-a10b-cd71c84b8e14 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:10.281685 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9e66c-7199-489d-a10b-cd71c84b8e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:10.289951 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:10.302124 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-27b9e66c-7199-489d-a10b-cd71c84b8e14 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:10.303129 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-27b9e66c-7199-489d-a10b-cd71c84b8e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:10.316205 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905a930-bbb2-47d6-92f1-dc3a21295bf4 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:10.353438 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff361829-e201-4cc0-9da2-394c6a9a85b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:10.354474 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff361829-e201-4cc0-9da2-394c6a9a85b9 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:10.354766 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff361829-e201-4cc0-9da2-394c6a9a85b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:10.355043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff361829-e201-4cc0-9da2-394c6a9a85b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:10.366880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff361829-e201-4cc0-9da2-394c6a9a85b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:10.368574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff361829-e201-4cc0-9da2-394c6a9a85b9 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:10.380515 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 280/544] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:47:10.381365 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9e66c-7199-489d-a10b-cd71c84b8e14 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:10.394909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-ff361829-e201-4cc0-9da2-394c6a9a85b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:10.394909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:10.394909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:10.394909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:10.394909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:10.394909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:10.394909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:10.394909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:10.394909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:10.394909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:10.394909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:10.394909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:10.394909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:10.394909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:10.394909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:10.394909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:10.395851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:10.395851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:10.395851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:10.395851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:10.395851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:10.395851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:10.395851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:10.395851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:10.395851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:10.395851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:10.395851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:10.395851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:10.395851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:10.395851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:10.395851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:10.395851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:10.395851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:10.396675 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:10.396675 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:10.396675 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:10.396675 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 265/545] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:10.397328 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff361829-e201-4cc0-9da2-394c6a9a85b9 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:10.446859 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:10.499133 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9e66c-7199-489d-a10b-cd71c84b8e14 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:10.503045 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff361829-e201-4cc0-9da2-394c6a9a85b9 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:10.537422 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ea356-525c-42ad-909c-74135c44d8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:10.538199 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ea356-525c-42ad-909c-74135c44d8e9 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:10.538483 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ea356-525c-42ad-909c-74135c44d8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:10.539060 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ea356-525c-42ad-909c-74135c44d8e9 None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:10.540040 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ea356-525c-42ad-909c-74135c44d8e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:10.540271 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ea356-525c-42ad-909c-74135c44d8e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:10.541676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ea356-525c-42ad-909c-74135c44d8e9 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:10.543350 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4189d-8877-4c27-9dfa-e480c3dc93fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:10.543652 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:10.543958 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4189d-8877-4c27-9dfa-e480c3dc93fe None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:10.544233 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4189d-8877-4c27-9dfa-e480c3dc93fe None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:10.544505 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4189d-8877-4c27-9dfa-e480c3dc93fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:10.555175 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4189d-8877-4c27-9dfa-e480c3dc93fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:47:10.558503 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 281/546] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:10.559970 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ea356-525c-42ad-909c-74135c44d8e9 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:10.565608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-afd4189d-8877-4c27-9dfa-e480c3dc93fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:10.565608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:10.565608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:10.565608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:10.565608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:10.565608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:10.565608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:10.565608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:10.565608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:10.565608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:10.565608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:10.565608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:10.565608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:47:10.565608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:47:10.565608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:47:10.565608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:47:10.566511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:47:10.566511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:47:10.566511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:47:10.566511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:47:10.566511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:10.566511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:10.566511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:10.566511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:10.566511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:10.566511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:10.566511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:10.566511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:10.566511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:10.566511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:10.566511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:10.566511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:10.572531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:10.572531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:10.572531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:10.572531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:10.572531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:47:10.572531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:47:10.572531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:47:10.572531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:47:10.572531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:47:10.572531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:47:10.572531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:10.572531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:10.572531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 266/547] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 17 14:47:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:10.572531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4189d-8877-4c27-9dfa-e480c3dc93fe None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:10.677815 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4189d-8877-4c27-9dfa-e480c3dc93fe None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:10.682071 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ea356-525c-42ad-909c-74135c44d8e9 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:10.687709 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:10.715961 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097c7cf-c776-4caf-93d7-979b5673fcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:10.716613 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097c7cf-c776-4caf-93d7-979b5673fcf5 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:10.716854 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097c7cf-c776-4caf-93d7-979b5673fcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:10.717124 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097c7cf-c776-4caf-93d7-979b5673fcf5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:10.717821 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f69b3-93eb-4cbd-a15d-d3ac0e8a475c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:10.718359 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f69b3-93eb-4cbd-a15d-d3ac0e8a475c None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:10.718636 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f69b3-93eb-4cbd-a15d-d3ac0e8a475c None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:10.718909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f69b3-93eb-4cbd-a15d-d3ac0e8a475c None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:10.719556 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f69b3-93eb-4cbd-a15d-d3ac0e8a475c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:10.719855 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f69b3-93eb-4cbd-a15d-d3ac0e8a475c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:10.721212 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f69b3-93eb-4cbd-a15d-d3ac0e8a475c None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:10.726128 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097c7cf-c776-4caf-93d7-979b5673fcf5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:10.727572 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097c7cf-c776-4caf-93d7-979b5673fcf5 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:10.733776 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 282/548] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:10.734575 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f69b3-93eb-4cbd-a15d-d3ac0e8a475c None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:10.739377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-b097c7cf-c776-4caf-93d7-979b5673fcf5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:47:10.739377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:10.739377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:10.739377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:10.739377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:10.739377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:10.739377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:10.739377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:10.739377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:10.739377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:10.739377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:10.739377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:10.739377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:47:10.739377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:47:10.739377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:47:10.739377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:47:10.740279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:10.740279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:10.740279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:47:10.740279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:10.740279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:47:10.740279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:10.740279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:10.740279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:10.740279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:10.740279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:10.740279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:10.740279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:10.740279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:10.740279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:10.740279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:10.740279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:10.740279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:10.740279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:10.741775 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:10.741775 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:10.741775 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:47:10.741775 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:47:10.741775 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:47:10.741775 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:47:10.741775 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:47:10.741775 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:47:10.741775 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:47:10.741775 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:10.741775 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 267/549] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Aug 17 14:47:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:10.741775 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097c7cf-c776-4caf-93d7-979b5673fcf5 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:10.790789 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:10.835928 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f69b3-93eb-4cbd-a15d-d3ac0e8a475c None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:10.842304 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097c7cf-c776-4caf-93d7-979b5673fcf5 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:10.869236 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220c896-90bc-46b4-89d6-eec64650e973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:10.869929 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220c896-90bc-46b4-89d6-eec64650e973 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:10.871137 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220c896-90bc-46b4-89d6-eec64650e973 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:10.871570 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220c896-90bc-46b4-89d6-eec64650e973 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:10.872242 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220c896-90bc-46b4-89d6-eec64650e973 None admin] RBAC: Adding query filter params (name=service) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:10.872540 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220c896-90bc-46b4-89d6-eec64650e973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:10.873916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220c896-90bc-46b4-89d6-eec64650e973 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:10.876845 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720fa62-4bf1-4322-9d8f-f3807bec0f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:10.877461 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720fa62-4bf1-4322-9d8f-f3807bec0f78 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:10.877753 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720fa62-4bf1-4322-9d8f-f3807bec0f78 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:10.878040 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720fa62-4bf1-4322-9d8f-f3807bec0f78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:10.881623 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 283/550] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 17 14:47:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:10.882422 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220c896-90bc-46b4-89d6-eec64650e973 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:10.889840 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720fa62-4bf1-4322-9d8f-f3807bec0f78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:47:10.895011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-0720fa62-4bf1-4322-9d8f-f3807bec0f78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:10.895011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:10.895011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:10.895011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:10.895011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:10.895011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:10.895011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:10.895011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:10.895011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:10.895011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:10.895011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:10.895011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:10.895011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:47:10.895011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:47:10.895011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:47:10.895011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:47:10.896086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:47:10.896086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:47:10.896086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:47:10.896086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:47:10.896086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:10.896086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:10.896086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:10.896086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:10.896086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:10.896086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:10.896086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:10.896086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:10.896086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:10.896086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:10.896086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:10.896086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:10.896868 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:10.896868 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:10.896868 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:10.896868 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:10.896868 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:47:10.896868 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:47:10.896868 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:47:10.896868 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:47:10.896868 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:47:10.896868 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:47:10.896868 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:10.896868 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:10.896868 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 268/551] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 17 14:47:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:10.896868 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720fa62-4bf1-4322-9d8f-f3807bec0f78 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:10.926110 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:10.986941 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220c896-90bc-46b4-89d6-eec64650e973 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:11.003366 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720fa62-4bf1-4322-9d8f-f3807bec0f78 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:11.003498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:11.022084 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7b3a8-8558-498e-9672-6aff58dd3743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:11.022703 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7b3a8-8558-498e-9672-6aff58dd3743 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:11.022986 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7b3a8-8558-498e-9672-6aff58dd3743 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:11.023257 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7b3a8-8558-498e-9672-6aff58dd3743 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:11.031922 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7b3a8-8558-498e-9672-6aff58dd3743 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:11.033345 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7b3a8-8558-498e-9672-6aff58dd3743 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:11.037055 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51658bb7-6081-44a1-95b9-4ea2bc621f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:11.038089 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51658bb7-6081-44a1-95b9-4ea2bc621f40 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:11.038428 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51658bb7-6081-44a1-95b9-4ea2bc621f40 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:11.038862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51658bb7-6081-44a1-95b9-4ea2bc621f40 None admin] PATH_INFO: `/v3/users` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:11.039805 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51658bb7-6081-44a1-95b9-4ea2bc621f40 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:11.040111 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51658bb7-6081-44a1-95b9-4ea2bc621f40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:11.041562 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51658bb7-6081-44a1-95b9-4ea2bc621f40 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:11.045336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-77f7b3a8-8558-498e-9672-6aff58dd3743 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 14:47:11.045336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:11.045336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:11.045336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:11.045336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:11.045336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:11.045336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:11.045336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:11.045336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:11.045336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:11.045336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:11.045336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:11.045336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:47:11.045336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:47:11.045336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:47:11.045336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:47:11.046299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:11.046299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:11.046299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:47:11.046299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:11.046299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:47:11.046299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:11.046299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:11.046299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:11.046299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:11.046299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:11.046299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:11.046299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:11.046299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:11.046299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:11.046299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:11.046299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:11.046299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:11.046299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:11.047705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:11.047705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:11.047705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:47:11.047705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:47:11.047705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:47:11.047705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:47:11.047705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:47:11.047705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:47:11.047705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 14:47:11.047705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:11.047705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 284/552] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:47:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:11.048276 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7b3a8-8558-498e-9672-6aff58dd3743 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:11.060121 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 269/553] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Aug 17 14:47:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:11.060954 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51658bb7-6081-44a1-95b9-4ea2bc621f40 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:11.146514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:11.153387 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7b3a8-8558-498e-9672-6aff58dd3743 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:11.161788 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51658bb7-6081-44a1-95b9-4ea2bc621f40 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:11.188039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6e59c-f018-4fca-9233-b7945b4cfd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:11.188662 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6e59c-f018-4fca-9233-b7945b4cfd04 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:11.188940 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6e59c-f018-4fca-9233-b7945b4cfd04 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:11.189210 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6e59c-f018-4fca-9233-b7945b4cfd04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:11.195682 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d837149-5074-4a74-a47b-975d1c97d5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:11.196283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d837149-5074-4a74-a47b-975d1c97d5bf None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:11.196557 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d837149-5074-4a74-a47b-975d1c97d5bf None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:11.196824 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d837149-5074-4a74-a47b-975d1c97d5bf None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:11.197487 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d837149-5074-4a74-a47b-975d1c97d5bf None admin] RBAC: Adding query filter params (name=service) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:11.197820 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d837149-5074-4a74-a47b-975d1c97d5bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:11.199353 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d837149-5074-4a74-a47b-975d1c97d5bf None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:11.199878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6e59c-f018-4fca-9233-b7945b4cfd04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:11.201318 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6e59c-f018-4fca-9233-b7945b4cfd04 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:11.207340 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 270/554] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 17 14:47:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:11.208197 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d837149-5074-4a74-a47b-975d1c97d5bf None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:11.217361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-65b6e59c-f018-4fca-9233-b7945b4cfd04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:11.217361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:11.217361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:11.217361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:11.217361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:11.217361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:11.217361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:11.217361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:11.217361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:11.217361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:11.217361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:11.217361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:11.217361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:11.217361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:11.217361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:11.217361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:11.218633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:11.218633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:11.218633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:11.218633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:11.218633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:11.218633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:11.218633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:11.218633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:11.218633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:11.218633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:11.218633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:11.218633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:11.218633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:11.218633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:11.218633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:11.218633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:11.218633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:11.219607 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:11.219607 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:11.219607 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:11.219607 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 285/555] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:11.219607 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6e59c-f018-4fca-9233-b7945b4cfd04 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:11.250698 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:11.310564 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d837149-5074-4a74-a47b-975d1c97d5bf None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:11.324321 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6e59c-f018-4fca-9233-b7945b4cfd04 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:11.344946 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fa702-ad03-4b69-8b4c-9719d0b1530e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:11.345534 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fa702-ad03-4b69-8b4c-9719d0b1530e None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:11.345842 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fa702-ad03-4b69-8b4c-9719d0b1530e None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:11.346113 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fa702-ad03-4b69-8b4c-9719d0b1530e None admin] PATH_INFO: `/v3/users` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:11.346821 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fa702-ad03-4b69-8b4c-9719d0b1530e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:11.347119 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fa702-ad03-4b69-8b4c-9719d0b1530e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:11.348526 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fa702-ad03-4b69-8b4c-9719d0b1530e None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:11.357419 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3182df-949d-480c-9e19-961f2e1d4c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:11.358062 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3182df-949d-480c-9e19-961f2e1d4c68 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:11.358363 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3182df-949d-480c-9e19-961f2e1d4c68 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:11.358629 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3182df-949d-480c-9e19-961f2e1d4c68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:11.366245 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 271/556] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Aug 17 14:47:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:11.367239 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fa702-ad03-4b69-8b4c-9719d0b1530e None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:11.369238 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3182df-949d-480c-9e19-961f2e1d4c68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:11.371891 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3182df-949d-480c-9e19-961f2e1d4c68 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:11.377552 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:11.389504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-ca3182df-949d-480c-9e19-961f2e1d4c68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:11.389504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:11.389504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:11.389504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:11.389504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:11.389504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:11.389504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:11.389504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:11.389504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:11.389504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:11.389504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:11.389504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:11.389504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:11.389504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:11.389504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:11.389504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:11.390630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:11.390630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:11.390630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:11.390630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:11.390630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:11.390630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:11.390630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:11.390630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:11.390630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:11.390630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:11.390630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:11.390630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:11.390630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:11.390630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:11.390630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:11.390630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:11.390630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:11.391487 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:11.391487 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:11.391487 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:11.391487 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 286/557] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:11.391487 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3182df-949d-480c-9e19-961f2e1d4c68 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:11.473481 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fa702-ad03-4b69-8b4c-9719d0b1530e None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:11.476297 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:11.496895 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3182df-949d-480c-9e19-961f2e1d4c68 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:11.508945 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eac1d1-f8d8-41d5-9c0a-fbf597e0473b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:11.509566 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eac1d1-f8d8-41d5-9c0a-fbf597e0473b None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:11.509875 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eac1d1-f8d8-41d5-9c0a-fbf597e0473b None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:11.510156 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eac1d1-f8d8-41d5-9c0a-fbf597e0473b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:11.520195 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eac1d1-f8d8-41d5-9c0a-fbf597e0473b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:11.521635 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eac1d1-f8d8-41d5-9c0a-fbf597e0473b None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:11.530047 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77441f-41e3-4314-929d-6c81a5195c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:11.530638 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77441f-41e3-4314-929d-6c81a5195c5c None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:11.530915 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77441f-41e3-4314-929d-6c81a5195c5c None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:11.531183 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77441f-41e3-4314-929d-6c81a5195c5c None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:11.531814 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77441f-41e3-4314-929d-6c81a5195c5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:11.532108 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77441f-41e3-4314-929d-6c81a5195c5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:11.533433 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77441f-41e3-4314-929d-6c81a5195c5c None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:11.536384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-06eac1d1-f8d8-41d5-9c0a-fbf597e0473b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:11.536384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:11.536384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:11.536384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:11.536384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:11.536384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:11.536384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:11.536384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:11.536384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:11.536384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:11.536384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:11.536384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:11.536384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:11.536384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:11.536384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:11.536384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:11.537867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:11.537867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:11.537867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:11.537867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:11.537867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:11.537867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:11.537867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:11.537867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:11.537867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:11.537867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:11.537867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:11.537867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:11.537867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:11.537867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:11.537867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:11.537867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:11.537867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:11.538740 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:11.538740 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:11.538740 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:11.538740 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 272/558] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:11.538740 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eac1d1-f8d8-41d5-9c0a-fbf597e0473b None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:11.547450 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 287/559] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:11.548748 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77441f-41e3-4314-929d-6c81a5195c5c None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:11.600515 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:11.643674 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eac1d1-f8d8-41d5-9c0a-fbf597e0473b None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:11.652897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77441f-41e3-4314-929d-6c81a5195c5c None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:11.676301 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb75f0-f2a9-4154-93f7-d957e02d4b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:11.676916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb75f0-f2a9-4154-93f7-d957e02d4b18 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:11.677195 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb75f0-f2a9-4154-93f7-d957e02d4b18 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:11.677465 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb75f0-f2a9-4154-93f7-d957e02d4b18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:11.687581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a92783-6897-49bf-91dc-f05894099d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:11.688172 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a92783-6897-49bf-91dc-f05894099d1a None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:11.688448 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a92783-6897-49bf-91dc-f05894099d1a None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:11.688661 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb75f0-f2a9-4154-93f7-d957e02d4b18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:11.688756 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a92783-6897-49bf-91dc-f05894099d1a None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:11.689339 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a92783-6897-49bf-91dc-f05894099d1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:11.689639 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a92783-6897-49bf-91dc-f05894099d1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:11.690389 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb75f0-f2a9-4154-93f7-d957e02d4b18 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:11.691013 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a92783-6897-49bf-91dc-f05894099d1a None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:11.699806 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:11.703126 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 288/560] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:11.704224 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a92783-6897-49bf-91dc-f05894099d1a None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:11.704935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-3cdb75f0-f2a9-4154-93f7-d957e02d4b18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:11.704935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:11.704935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:11.704935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:11.704935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:11.704935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:11.704935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:11.704935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:11.704935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:11.704935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:11.704935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:11.704935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:11.704935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:11.704935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:11.704935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:11.704935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:11.705978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:11.705978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:11.705978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:11.705978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:11.705978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:11.705978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:11.705978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:11.705978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:11.705978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:11.705978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:11.705978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:11.705978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:11.705978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:11.705978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:11.705978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:11.705978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:11.705978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:11.706893 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:11.706893 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:11.706893 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:11.710327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 273/561] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:11.711161 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb75f0-f2a9-4154-93f7-d957e02d4b18 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:11.806758 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a92783-6897-49bf-91dc-f05894099d1a None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:11.811383 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb75f0-f2a9-4154-93f7-d957e02d4b18 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:11.821335 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:11.840386 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3860cc-212b-4b8c-ba05-95131c808dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:11.840985 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3860cc-212b-4b8c-ba05-95131c808dc0 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:11.841266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3860cc-212b-4b8c-ba05-95131c808dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:11.841538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3860cc-212b-4b8c-ba05-95131c808dc0 None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:11.842206 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3860cc-212b-4b8c-ba05-95131c808dc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:11.842506 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3860cc-212b-4b8c-ba05-95131c808dc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:11.843887 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3860cc-212b-4b8c-ba05-95131c808dc0 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:11.846336 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fe471-57e2-47d5-b429-f14d60933d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:11.846950 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fe471-57e2-47d5-b429-f14d60933d85 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:11.847228 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fe471-57e2-47d5-b429-f14d60933d85 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:11.847495 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fe471-57e2-47d5-b429-f14d60933d85 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:11.855923 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 289/562] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:11.856449 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fe471-57e2-47d5-b429-f14d60933d85 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:11.856651 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3860cc-212b-4b8c-ba05-95131c808dc0 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:11.857968 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fe471-57e2-47d5-b429-f14d60933d85 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:11.869656 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-ae0fe471-57e2-47d5-b429-f14d60933d85 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 14:47:11.869656 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:11.869656 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:11.869656 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:11.869656 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:11.869656 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:11.869656 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:11.869656 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:11.869656 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:11.869656 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:11.869656 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:11.869656 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:11.869656 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:47:11.869656 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:47:11.869656 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:47:11.869656 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:47:11.871539 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:11.871539 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:11.871539 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:47:11.871539 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:11.871539 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:47:11.871539 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:11.871539 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:11.871539 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:11.871539 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:11.871539 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:11.871539 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:11.871539 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:11.871539 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:11.871539 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:11.871539 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:11.871539 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:11.871539 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:11.871539 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:11.872697 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:11.872697 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:11.872697 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:47:11.872697 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:47:11.872697 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:47:11.872697 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:47:11.872697 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:47:11.872697 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:47:11.872697 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 14:47:11.872697 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:11.872697 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 274/563] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:47:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:11.872697 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fe471-57e2-47d5-b429-f14d60933d85 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:11.917786 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:11.959487 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3860cc-212b-4b8c-ba05-95131c808dc0 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:11.971732 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fe471-57e2-47d5-b429-f14d60933d85 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:11.996624 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc142e-84d2-4f92-bfa6-7c6a198dcec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:11.997317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc142e-84d2-4f92-bfa6-7c6a198dcec5 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:11.997593 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc142e-84d2-4f92-bfa6-7c6a198dcec5 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:11.997900 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc142e-84d2-4f92-bfa6-7c6a198dcec5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:12.005284 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc142e-84d2-4f92-bfa6-7c6a198dcec5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:12.006731 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc142e-84d2-4f92-bfa6-7c6a198dcec5 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:12.007251 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd4ef5-a5ca-4bc5-a3bb-d03453ad9efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:12.007848 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd4ef5-a5ca-4bc5-a3bb-d03453ad9efe None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:12.008124 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd4ef5-a5ca-4bc5-a3bb-d03453ad9efe None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:12.008395 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd4ef5-a5ca-4bc5-a3bb-d03453ad9efe None admin] PATH_INFO: `/v3/domains` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:12.009242 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd4ef5-a5ca-4bc5-a3bb-d03453ad9efe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:12.009358 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd4ef5-a5ca-4bc5-a3bb-d03453ad9efe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:12.011370 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd4ef5-a5ca-4bc5-a3bb-d03453ad9efe None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:12.018538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-84dc142e-84d2-4f92-bfa6-7c6a198dcec5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:12.018538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:12.018538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:12.018538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:12.018538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:12.018538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:12.018538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:12.018538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:12.018538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:12.018538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:12.018538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:12.018538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:12.018538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:47:12.018538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:47:12.018538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:47:12.019430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:47:12.019430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:12.019430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:12.019430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:12.019430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:12.019430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:12.019430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:12.019430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:12.019430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:12.019430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:12.019430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:12.019430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:12.019430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:12.019430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:12.019430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:12.019430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:12.019430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:12.020303 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:47:12.020303 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:47:12.020303 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:47:12.020303 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:47:12.020303 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:47:12.020303 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:47:12.020303 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:12.020303 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:12.020303 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 290/564] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:12.020783 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc142e-84d2-4f92-bfa6-7c6a198dcec5 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:12.025120 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 275/565] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:12.025942 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd4ef5-a5ca-4bc5-a3bb-d03453ad9efe None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:12.055918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:12.127227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd4ef5-a5ca-4bc5-a3bb-d03453ad9efe None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:12.129276 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc142e-84d2-4f92-bfa6-7c6a198dcec5 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:12.150005 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:12.162467 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d9476-37bf-4dc9-8a9e-2876cddea6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:12.163123 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d9476-37bf-4dc9-8a9e-2876cddea6f9 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:12.163402 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d9476-37bf-4dc9-8a9e-2876cddea6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:12.163671 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d9476-37bf-4dc9-8a9e-2876cddea6f9 None admin] PATH_INFO: `/v3/users` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:12.164141 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50e44b-ffac-4435-bd70-a1a314fd3a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:12.164382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d9476-37bf-4dc9-8a9e-2876cddea6f9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:12.164684 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d9476-37bf-4dc9-8a9e-2876cddea6f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:12.164774 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50e44b-ffac-4435-bd70-a1a314fd3a1f None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:12.165035 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50e44b-ffac-4435-bd70-a1a314fd3a1f None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:12.165308 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50e44b-ffac-4435-bd70-a1a314fd3a1f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:12.167217 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d9476-37bf-4dc9-8a9e-2876cddea6f9 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:12.174364 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50e44b-ffac-4435-bd70-a1a314fd3a1f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:12.175775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50e44b-ffac-4435-bd70-a1a314fd3a1f None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:12.185860 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 276/566] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Aug 17 14:47:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:12.186671 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d9476-37bf-4dc9-8a9e-2876cddea6f9 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:12.188079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-9c50e44b-ffac-4435-bd70-a1a314fd3a1f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 14:47:12.188079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:12.188079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:12.188079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:12.188079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:12.188079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:12.188079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:12.188079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:12.188079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:12.188079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:12.188079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:12.188079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:12.188079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:47:12.188079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:47:12.188079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:47:12.188079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:47:12.188987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:12.188987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:12.188987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:47:12.188987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:12.188987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:47:12.188987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:12.188987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:12.188987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:12.188987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:12.188987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:12.188987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:12.188987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:12.188987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:12.188987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:12.188987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:12.188987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:12.188987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:12.188987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:12.189962 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:12.189962 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:12.189962 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:47:12.189962 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:47:12.189962 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:47:12.189962 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:47:12.189962 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:47:12.189962 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:47:12.189962 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 14:47:12.189962 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:12.189962 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 291/567] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 17 14:47:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:12.189962 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50e44b-ffac-4435-bd70-a1a314fd3a1f None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:12.276983 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:12.290588 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d9476-37bf-4dc9-8a9e-2876cddea6f9 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:12.291314 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50e44b-ffac-4435-bd70-a1a314fd3a1f None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:12.325998 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60295e-1c62-490f-b790-9e6b6d1f152b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:12.326183 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfea06d-6583-4938-9ff7-91385f49edfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:12.326594 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfea06d-6583-4938-9ff7-91385f49edfc None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:12.326689 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60295e-1c62-490f-b790-9e6b6d1f152b None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:12.326870 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60295e-1c62-490f-b790-9e6b6d1f152b None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:12.326962 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfea06d-6583-4938-9ff7-91385f49edfc None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:12.327133 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60295e-1c62-490f-b790-9e6b6d1f152b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:12.327220 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfea06d-6583-4938-9ff7-91385f49edfc None admin] PATH_INFO: `/v3/projects` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:12.327815 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfea06d-6583-4938-9ff7-91385f49edfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:12.328118 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfea06d-6583-4938-9ff7-91385f49edfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:12.329547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfea06d-6583-4938-9ff7-91385f49edfc None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:12.333784 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60295e-1c62-490f-b790-9e6b6d1f152b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:12.335195 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60295e-1c62-490f-b790-9e6b6d1f152b None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:12.341462 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 277/568] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:47:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:12.342102 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfea06d-6583-4938-9ff7-91385f49edfc None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:12.351457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-6d60295e-1c62-490f-b790-9e6b6d1f152b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:12.351457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:12.351457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:12.351457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:12.351457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:12.351457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:12.351457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:12.351457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:12.351457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:12.351457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:12.351457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:12.351457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:12.351457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:47:12.351457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:47:12.351457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:47:12.352491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:47:12.352491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:12.352491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:12.352491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:12.352491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:12.352491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:12.352491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:12.352491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:12.352491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:12.352491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:12.352491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:12.352491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:12.352491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:12.352491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:12.352491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:12.352491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:12.352491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:12.353406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:47:12.353406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:47:12.353406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:47:12.353406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:47:12.353406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:47:12.353406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:47:12.353406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:12.353406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:12.353406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 292/569] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:12.353406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60295e-1c62-490f-b790-9e6b6d1f152b None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:12.400165 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:12.446145 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfea06d-6583-4938-9ff7-91385f49edfc None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:12.460738 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60295e-1c62-490f-b790-9e6b6d1f152b None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:12.480313 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa03eb7-d7fb-48cf-bbe6-2316bc4011b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:12.480952 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa03eb7-d7fb-48cf-bbe6-2316bc4011b0 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:12.481236 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa03eb7-d7fb-48cf-bbe6-2316bc4011b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:12.481506 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa03eb7-d7fb-48cf-bbe6-2316bc4011b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:12.492019 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa03eb7-d7fb-48cf-bbe6-2316bc4011b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:12.493533 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa03eb7-d7fb-48cf-bbe6-2316bc4011b0 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:12.494056 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43f306-ddac-4ca8-ab13-2f6bf5171a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:12.494673 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43f306-ddac-4ca8-ab13-2f6bf5171a61 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:12.495869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43f306-ddac-4ca8-ab13-2f6bf5171a61 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:12.496181 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43f306-ddac-4ca8-ab13-2f6bf5171a61 None admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:12.496907 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43f306-ddac-4ca8-ab13-2f6bf5171a61 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:12.497208 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43f306-ddac-4ca8-ab13-2f6bf5171a61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:12.498727 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43f306-ddac-4ca8-ab13-2f6bf5171a61 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:12.503342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:12.510151 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-4aa03eb7-d7fb-48cf-bbe6-2316bc4011b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:12.510151 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:12.510151 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:12.510151 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:12.510151 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:12.510151 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:12.510151 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:12.510151 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:12.510151 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:12.510151 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:12.510151 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:12.510151 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:12.510151 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:12.510151 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:12.510151 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:12.510151 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:12.511412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:12.511412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:12.511412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:12.511412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:12.511412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:12.511412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:12.511412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:12.511412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:12.511412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:12.511412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:12.511412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:12.511412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:12.511412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:12.511412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:12.511412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:12.511412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:12.511412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:12.512308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:12.512308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:12.512308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:12.512308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 278/570] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:12.512538 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa03eb7-d7fb-48cf-bbe6-2316bc4011b0 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:12.522623 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 293/571] 10.222.0.30 () {56 vars in 1139 bytes} [Wed Aug 17 14:47:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:12.522623 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43f306-ddac-4ca8-ab13-2f6bf5171a61 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:12.615131 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa03eb7-d7fb-48cf-bbe6-2316bc4011b0 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:12.618436 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:12.622967 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43f306-ddac-4ca8-ab13-2f6bf5171a61 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:12.649652 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60c71e-41d8-450a-a725-577255ae658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:12.650379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60c71e-41d8-450a-a725-577255ae658b None admin] REQUEST_METHOD: `PUT` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:12.650599 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60c71e-41d8-450a-a725-577255ae658b None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:12.650863 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60c71e-41d8-450a-a725-577255ae658b None admin] PATH_INFO: `/v3/projects/e9d40280440c4d25b6d60a431d6f788b/users/8aca6a001d3b479bab684772768d49f5/roles/cb99a767f5264f2dace0994d13d0fbc8` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:12.658088 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b51b4-7f46-49a8-b946-3478f8f86d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:12.658685 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b51b4-7f46-49a8-b946-3478f8f86d54 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:12.659364 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b51b4-7f46-49a8-b946-3478f8f86d54 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:12.659642 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b51b4-7f46-49a8-b946-3478f8f86d54 None admin] PATH_INFO: `/v3/projects` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:12.660487 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b51b4-7f46-49a8-b946-3478f8f86d54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:12.660792 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b51b4-7f46-49a8-b946-3478f8f86d54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:12.662247 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b51b4-7f46-49a8-b946-3478f8f86d54 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:12.664873 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60c71e-41d8-450a-a725-577255ae658b None admin] RBAC: Authorizing `identity:create_grant(project_id=e9d40280440c4d25b6d60a431d6f788b, user_id=8aca6a001d3b479bab684772768d49f5, role_id=cb99a767f5264f2dace0994d13d0fbc8)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:12.666310 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60c71e-41d8-450a-a725-577255ae658b None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:12.674097 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 294/572] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:47:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:12.674894 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b51b4-7f46-49a8-b946-3478f8f86d54 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:12.684537 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 279/573] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 17 14:47:12 2022] PUT /identity/v3/projects/e9d40280440c4d25b6d60a431d6f788b/users/8aca6a001d3b479bab684772768d49f5/roles/cb99a767f5264f2dace0994d13d0fbc8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:47:12.685353 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60c71e-41d8-450a-a725-577255ae658b None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:12.741192 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:12.801063 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b51b4-7f46-49a8-b946-3478f8f86d54 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:12.801853 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60c71e-41d8-450a-a725-577255ae658b None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:12.836995 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbd752-0915-4ccc-8120-8f2b23a10ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:12.837621 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbd752-0915-4ccc-8120-8f2b23a10ede None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:12.837944 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbd752-0915-4ccc-8120-8f2b23a10ede None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:12.838217 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbd752-0915-4ccc-8120-8f2b23a10ede None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:12.839458 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbd752-0915-4ccc-8120-8f2b23a10ede None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:12.839761 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbd752-0915-4ccc-8120-8f2b23a10ede None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:12.841156 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbd752-0915-4ccc-8120-8f2b23a10ede None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:12.844223 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1459772-87cb-4d11-922f-2b0296f3d1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:12.845107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1459772-87cb-4d11-922f-2b0296f3d1cf None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:12.845593 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1459772-87cb-4d11-922f-2b0296f3d1cf None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:12.846071 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1459772-87cb-4d11-922f-2b0296f3d1cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:12.858497 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1459772-87cb-4d11-922f-2b0296f3d1cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:12.858884 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 295/574] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:12.860011 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbd752-0915-4ccc-8120-8f2b23a10ede None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:12.861064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1459772-87cb-4d11-922f-2b0296f3d1cf None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:12.882741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-b1459772-87cb-4d11-922f-2b0296f3d1cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:12.882741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:12.882741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:12.882741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:12.882741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:12.882741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:12.882741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:12.882741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:12.882741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:12.882741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:12.882741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:12.882741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:12.882741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:12.882741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:12.882741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:12.882741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:12.883880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:12.883880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:12.883880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:12.883880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:12.883880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:12.883880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:12.883880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:12.883880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:12.883880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:12.883880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:12.883880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:12.883880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:12.883880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:12.883880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:12.883880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:12.883880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:12.883880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:12.884792 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:12.884792 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:12.884792 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:12.884960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:12.885032 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 280/575] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:12.885032 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1459772-87cb-4d11-922f-2b0296f3d1cf None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:12.978411 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbd752-0915-4ccc-8120-8f2b23a10ede None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:12.997689 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1459772-87cb-4d11-922f-2b0296f3d1cf None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:12.999425 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:13.020998 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b3de6-f585-44c8-899e-42ce6daf24e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:13.021648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b3de6-f585-44c8-899e-42ce6daf24e8 None admin] REQUEST_METHOD: `PUT` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:13.021970 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b3de6-f585-44c8-899e-42ce6daf24e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:13.022247 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b3de6-f585-44c8-899e-42ce6daf24e8 None admin] PATH_INFO: `/v3/projects/e9d40280440c4d25b6d60a431d6f788b/users/272278199c5149a1ad326f22ef11f4e1/roles/cb99a767f5264f2dace0994d13d0fbc8` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:13.037793 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b3de6-f585-44c8-899e-42ce6daf24e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9d40280440c4d25b6d60a431d6f788b, user_id=272278199c5149a1ad326f22ef11f4e1, role_id=cb99a767f5264f2dace0994d13d0fbc8)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:13.039271 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b3de6-f585-44c8-899e-42ce6daf24e8 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:13.043829 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d09e86-ed3e-43be-bbc2-2c5735f4bf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:13.044417 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d09e86-ed3e-43be-bbc2-2c5735f4bf18 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:13.044718 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d09e86-ed3e-43be-bbc2-2c5735f4bf18 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:13.044979 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d09e86-ed3e-43be-bbc2-2c5735f4bf18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:13.052409 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d09e86-ed3e-43be-bbc2-2c5735f4bf18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:13.061758 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 296/576] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 17 14:47:12 2022] PUT /identity/v3/projects/e9d40280440c4d25b6d60a431d6f788b/users/272278199c5149a1ad326f22ef11f4e1/roles/cb99a767f5264f2dace0994d13d0fbc8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:47:13.061967 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d09e86-ed3e-43be-bbc2-2c5735f4bf18 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:13.062056 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b3de6-f585-44c8-899e-42ce6daf24e8 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:13.076382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-c9d09e86-ed3e-43be-bbc2-2c5735f4bf18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:13.076382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:13.076382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:13.076382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:13.076382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:13.076382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:13.076382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:13.076382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:13.076382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:13.076382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:13.076382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:13.076382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:13.076382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:47:13.076382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:47:13.076382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:47:13.077565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:47:13.077565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:13.077565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:13.077565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:13.077565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:13.077565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:13.077565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:13.077565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:13.077565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:13.077565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:13.077565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:13.077565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:13.077565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:13.077565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:13.077565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:13.077565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:13.077565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:13.078559 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:47:13.078559 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:47:13.078559 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:47:13.078559 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:47:13.078559 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:47:13.078559 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:47:13.078559 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:13.078559 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:13.078989 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 281/577] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:13.084441 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d09e86-ed3e-43be-bbc2-2c5735f4bf18 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:13.146593 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:13.194977 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b3de6-f585-44c8-899e-42ce6daf24e8 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:13.207646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d09e86-ed3e-43be-bbc2-2c5735f4bf18 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:13.237091 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81356c-ee30-4d76-b4d7-6a65827ea485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:13.238119 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81356c-ee30-4d76-b4d7-6a65827ea485 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:13.238624 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81356c-ee30-4d76-b4d7-6a65827ea485 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:13.239092 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81356c-ee30-4d76-b4d7-6a65827ea485 None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:13.239974 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81356c-ee30-4d76-b4d7-6a65827ea485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:13.240534 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81356c-ee30-4d76-b4d7-6a65827ea485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:13.242159 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81356c-ee30-4d76-b4d7-6a65827ea485 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:13.264159 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5491711-d094-42df-8172-536ce33ea403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:13.264868 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5491711-d094-42df-8172-536ce33ea403 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:13.265066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5491711-d094-42df-8172-536ce33ea403 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:13.265263 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 297/578] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:13.265385 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5491711-d094-42df-8172-536ce33ea403 None admin] PATH_INFO: `/v3/projects` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:13.268027 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5491711-d094-42df-8172-536ce33ea403 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:13.268027 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5491711-d094-42df-8172-536ce33ea403 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:13.268027 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5491711-d094-42df-8172-536ce33ea403 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:13.271379 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81356c-ee30-4d76-b4d7-6a65827ea485 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:13.284411 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 282/579] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:47:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:47:13.290362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5491711-d094-42df-8172-536ce33ea403 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:13.318911 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:13.395381 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81356c-ee30-4d76-b4d7-6a65827ea485 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:13.423715 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:13.426763 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5491711-d094-42df-8172-536ce33ea403 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:13.435155 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4ac38-bb25-4082-b62c-f3d22afba5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:13.435904 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4ac38-bb25-4082-b62c-f3d22afba5d6 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:13.436812 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4ac38-bb25-4082-b62c-f3d22afba5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:13.437184 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4ac38-bb25-4082-b62c-f3d22afba5d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:13.446478 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4ac38-bb25-4082-b62c-f3d22afba5d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:13.449045 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4ac38-bb25-4082-b62c-f3d22afba5d6 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:13.465606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-52d4ac38-bb25-4082-b62c-f3d22afba5d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:13.465606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:13.465606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:13.465606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:13.465606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:13.465606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:13.465606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:13.465606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:13.465606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:13.465606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:13.465606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:13.465606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:13.465606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:47:13.465606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:47:13.465606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:47:13.466745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:47:13.466745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:13.466745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:13.466745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:13.466745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:13.466745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:13.466745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:13.466745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:13.466745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:13.466745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:13.466745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:13.466745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:13.466745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:13.466745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:13.466745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:13.466745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:13.466745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:13.467778 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:47:13.467778 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:47:13.467778 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:47:13.467778 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:47:13.467778 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:47:13.467778 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:47:13.467778 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:13.467778 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:13.468236 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354dea2-9855-460e-a99b-057bf2236746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:13.468236 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354dea2-9855-460e-a99b-057bf2236746 None admin] REQUEST_METHOD: `PUT` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:13.468411 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 298/580] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:13.468490 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354dea2-9855-460e-a99b-057bf2236746 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:13.468490 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354dea2-9855-460e-a99b-057bf2236746 None admin] PATH_INFO: `/v3/projects/e9d40280440c4d25b6d60a431d6f788b/users/1dacf10fc91547788a9f8bbedfa0f553/roles/cb99a767f5264f2dace0994d13d0fbc8` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:13.474283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4ac38-bb25-4082-b62c-f3d22afba5d6 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:13.496631 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354dea2-9855-460e-a99b-057bf2236746 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9d40280440c4d25b6d60a431d6f788b, user_id=1dacf10fc91547788a9f8bbedfa0f553, role_id=cb99a767f5264f2dace0994d13d0fbc8)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:13.498232 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354dea2-9855-460e-a99b-057bf2236746 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:13.518771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 283/581] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 17 14:47:13 2022] PUT /identity/v3/projects/e9d40280440c4d25b6d60a431d6f788b/users/1dacf10fc91547788a9f8bbedfa0f553/roles/cb99a767f5264f2dace0994d13d0fbc8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:47:13.602879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4ac38-bb25-4082-b62c-f3d22afba5d6 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:13.645874 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb79437-cfe1-4b4f-831e-4732fb910ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:13.646835 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79437-cfe1-4b4f-831e-4732fb910ccd None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:13.647355 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79437-cfe1-4b4f-831e-4732fb910ccd None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:13.647829 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79437-cfe1-4b4f-831e-4732fb910ccd None admin] PATH_INFO: `/v3/projects` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:13.648745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb79437-cfe1-4b4f-831e-4732fb910ccd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:13.649243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb79437-cfe1-4b4f-831e-4732fb910ccd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:13.650916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb79437-cfe1-4b4f-831e-4732fb910ccd None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:13.665992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 299/582] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:47:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:47:13.673211 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354dea2-9855-460e-a99b-057bf2236746 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:13.766206 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:13.792708 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354dea2-9855-460e-a99b-057bf2236746 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:13.828979 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada226b-4375-4085-87d3-d6dd5e2b211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:13.829631 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada226b-4375-4085-87d3-d6dd5e2b211b None admin] REQUEST_METHOD: `PUT` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:13.830012 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada226b-4375-4085-87d3-d6dd5e2b211b None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:13.830283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada226b-4375-4085-87d3-d6dd5e2b211b None admin] PATH_INFO: `/v3/projects/e9d40280440c4d25b6d60a431d6f788b/users/1e4147647f54499ba24b50fbecc5d38f/roles/cb99a767f5264f2dace0994d13d0fbc8` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:13.845624 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada226b-4375-4085-87d3-d6dd5e2b211b None admin] RBAC: Authorizing `identity:create_grant(project_id=e9d40280440c4d25b6d60a431d6f788b, user_id=1e4147647f54499ba24b50fbecc5d38f, role_id=cb99a767f5264f2dace0994d13d0fbc8)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:13.847171 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada226b-4375-4085-87d3-d6dd5e2b211b None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:13.864718 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 284/583] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 17 14:47:13 2022] PUT /identity/v3/projects/e9d40280440c4d25b6d60a431d6f788b/users/1e4147647f54499ba24b50fbecc5d38f/roles/cb99a767f5264f2dace0994d13d0fbc8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:47:14.976280 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08375f08-0ac2-4a23-b4d1-aff24426685f None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:14.977260 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08375f08-0ac2-4a23-b4d1-aff24426685f None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:14.977783 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08375f08-0ac2-4a23-b4d1-aff24426685f None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:14.980476 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 300/584] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:14.985248 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee503942-dc85-40f8-8495-09c8b7171aed None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:14.985648 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee503942-dc85-40f8-8495-09c8b7171aed None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:14.985862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee503942-dc85-40f8-8495-09c8b7171aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:15.008411 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-ee503942-dc85-40f8-8495-09c8b7171aed None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:15.009641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-ee503942-dc85-40f8-8495-09c8b7171aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:15.083288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 285/585] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:47:15.411738 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08375f08-0ac2-4a23-b4d1-aff24426685f None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:15.448929 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b818cc6-2ef6-43ba-a50e-d9cb7b1730cb None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:15.449456 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b818cc6-2ef6-43ba-a50e-d9cb7b1730cb None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:15.449749 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b818cc6-2ef6-43ba-a50e-d9cb7b1730cb None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:15.451111 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 286/586] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:47:15.457125 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1a5d1-fc32-4af3-9a47-35ec137703b9 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:15.457411 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1a5d1-fc32-4af3-9a47-35ec137703b9 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:15.457837 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1a5d1-fc32-4af3-9a47-35ec137703b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:15.468661 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:15.483399 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-08c1a5d1-fc32-4af3-9a47-35ec137703b9 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:15.484704 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-08c1a5d1-fc32-4af3-9a47-35ec137703b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:15.532117 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08375f08-0ac2-4a23-b4d1-aff24426685f None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:15.538488 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:15.581118 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005f2c7-92a0-43fd-9b64-d99d57611b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:15.581863 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 287/587] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:47:15.582367 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f2c7-92a0-43fd-9b64-d99d57611b31 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:15.582882 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f2c7-92a0-43fd-9b64-d99d57611b31 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:15.583357 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f2c7-92a0-43fd-9b64-d99d57611b31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:15.594631 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005f2c7-92a0-43fd-9b64-d99d57611b31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:47:15.599655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-5005f2c7-92a0-43fd-9b64-d99d57611b31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:15.599655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:15.599655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:15.599655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:15.599655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:15.599655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:15.599655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:15.599655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:15.599655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:15.599655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:15.599655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:15.599655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:15.599655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:47:15.599655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:47:15.599655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:47:15.599655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:47:15.600608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:47:15.600608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:47:15.600608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:47:15.600608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:47:15.600608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:15.600608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:15.600608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:15.600608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:15.600608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:15.600608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:15.600608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:15.600608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:15.600608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:15.600608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:15.600608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:15.600608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:15.601443 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:15.601443 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:15.601443 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:15.601443 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:15.601443 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:47:15.601443 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:47:15.601443 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:47:15.601443 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:47:15.601443 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:47:15.601443 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:47:15.601443 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:15.601443 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:15.604013 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 301/588] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 17 14:47:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:15.612672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1a5d1-fc32-4af3-9a47-35ec137703b9 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:15.728800 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1a5d1-fc32-4af3-9a47-35ec137703b9 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:15.767139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc866cb-c2b4-495d-adbc-598441c364b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:15.768111 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc866cb-c2b4-495d-adbc-598441c364b3 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:15.768621 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc866cb-c2b4-495d-adbc-598441c364b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:15.769121 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc866cb-c2b4-495d-adbc-598441c364b3 None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:15.770031 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc866cb-c2b4-495d-adbc-598441c364b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:15.770549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc866cb-c2b4-495d-adbc-598441c364b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:15.772199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc866cb-c2b4-495d-adbc-598441c364b3 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:15.782152 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 288/589] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 17 14:47:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:15.787987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005f2c7-92a0-43fd-9b64-d99d57611b31 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:15.874508 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5dba9-c2b6-4e6f-9e10-81086026a270 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:15.875137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5dba9-c2b6-4e6f-9e10-81086026a270 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:15.875633 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5dba9-c2b6-4e6f-9e10-81086026a270 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:15.877441 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 289/590] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:47:15.882758 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ba51b-c83b-4db4-8b05-df6bf19959f7 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:15.883304 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ba51b-c83b-4db4-8b05-df6bf19959f7 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:15.883784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ba51b-c83b-4db4-8b05-df6bf19959f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:15.898067 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005f2c7-92a0-43fd-9b64-d99d57611b31 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:15.904675 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-a81ba51b-c83b-4db4-8b05-df6bf19959f7 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:15.906279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-a81ba51b-c83b-4db4-8b05-df6bf19959f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:15.908143 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:15.936463 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b878b3-cdec-4be9-b177-c330a101e2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:15.937122 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b878b3-cdec-4be9-b177-c330a101e2bf None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:15.937434 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b878b3-cdec-4be9-b177-c330a101e2bf None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:15.937630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b878b3-cdec-4be9-b177-c330a101e2bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:15.949670 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b878b3-cdec-4be9-b177-c330a101e2bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:15.950724 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:15.951155 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b878b3-cdec-4be9-b177-c330a101e2bf None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:15.968072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-c1b878b3-cdec-4be9-b177-c330a101e2bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:15.968072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:15.968072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:15.968072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:15.968072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:15.968072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:15.968072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:15.968072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:15.968072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:15.968072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:15.968072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:15.968072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:15.968072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:15.968072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:15.968072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:15.968072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:15.969161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:15.969161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:15.969161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:15.969161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:15.969161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:15.969161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:15.969161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:15.969161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:15.969161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:15.969161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:15.969161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:15.969161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:15.969161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:15.969161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:15.969161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:15.969161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:15.969161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:15.970880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:15.970880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:15.970880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:15.970880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 302/591] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:15.971129 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b878b3-cdec-4be9-b177-c330a101e2bf None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:15.988773 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 290/592] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:47:15.989569 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ba51b-c83b-4db4-8b05-df6bf19959f7 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:16.091132 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b878b3-cdec-4be9-b177-c330a101e2bf None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:16.098721 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ba51b-c83b-4db4-8b05-df6bf19959f7 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:16.132244 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16a60b-e53a-435b-ad2c-6fb00c2a5455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:16.133293 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16a60b-e53a-435b-ad2c-6fb00c2a5455 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:16.133810 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16a60b-e53a-435b-ad2c-6fb00c2a5455 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:16.134312 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b837506-e2cd-489a-8fed-7b29fde42985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:16.134434 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16a60b-e53a-435b-ad2c-6fb00c2a5455 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:16.134958 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b837506-e2cd-489a-8fed-7b29fde42985 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:16.135233 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b837506-e2cd-489a-8fed-7b29fde42985 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:16.136033 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b837506-e2cd-489a-8fed-7b29fde42985 None admin] PATH_INFO: `/v3/domains` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:16.136680 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b837506-e2cd-489a-8fed-7b29fde42985 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:16.136977 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b837506-e2cd-489a-8fed-7b29fde42985 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:16.138357 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b837506-e2cd-489a-8fed-7b29fde42985 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:16.149487 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16a60b-e53a-435b-ad2c-6fb00c2a5455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:47:16.150017 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 291/593] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:16.151775 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ff112-a455-4f8d-8c90-4279496536a7 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:16.152124 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ff112-a455-4f8d-8c90-4279496536a7 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:16.152400 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ff112-a455-4f8d-8c90-4279496536a7 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:16.154119 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 292/594] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:16.156342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ff112-a455-4f8d-8c90-4279496536a7 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:16.157424 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-ff16a60b-e53a-435b-ad2c-6fb00c2a5455 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:16.157424 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:16.157424 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:16.157424 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:16.157424 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:16.157424 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:16.157424 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:16.157424 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:16.157424 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:16.157424 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:16.157424 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:16.157424 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:16.157424 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:47:16.157424 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:47:16.157424 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:47:16.157424 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:47:16.158581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:47:16.158581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:47:16.158581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:47:16.158581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:47:16.158581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:16.158581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:16.158581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:16.158581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:16.158581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:16.158581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:16.158581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:16.158581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:16.158581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:16.158581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:16.158581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:16.158581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:16.159608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:16.159608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:16.159608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:16.159608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:16.159608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:47:16.159608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:47:16.159608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:47:16.159608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:47:16.159608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:47:16.159608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:47:16.159608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:16.159608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:16.166819 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 303/595] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 17 14:47:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:16.166819 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846a44f-e1e9-43fa-ba98-c1fd3404f3cd None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:16.166819 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846a44f-e1e9-43fa-ba98-c1fd3404f3cd None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:16.166819 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846a44f-e1e9-43fa-ba98-c1fd3404f3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:16.184606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-f846a44f-e1e9-43fa-ba98-c1fd3404f3cd None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:16.185899 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-f846a44f-e1e9-43fa-ba98-c1fd3404f3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:16.196536 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:16.203872 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:16.263308 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 304/596] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:47:16.270612 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846a44f-e1e9-43fa-ba98-c1fd3404f3cd None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:16.271524 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ff112-a455-4f8d-8c90-4279496536a7 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:16.314276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff9bc3-2950-4dd1-ba2e-51ad5c2596a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:16.314949 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff9bc3-2950-4dd1-ba2e-51ad5c2596a0 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:16.315249 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff9bc3-2950-4dd1-ba2e-51ad5c2596a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:16.315521 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff9bc3-2950-4dd1-ba2e-51ad5c2596a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:16.325093 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff9bc3-2950-4dd1-ba2e-51ad5c2596a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:16.327331 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff9bc3-2950-4dd1-ba2e-51ad5c2596a0 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:16.339514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-33ff9bc3-2950-4dd1-ba2e-51ad5c2596a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:47:16.339514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:16.339514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:16.339514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:16.339514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:16.339514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:16.339514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:16.339514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:16.339514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:16.339514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:16.339514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:16.339514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:16.339514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:47:16.339514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:47:16.339514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:47:16.339514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:47:16.340641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:16.340641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:16.340641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:47:16.340641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:16.340641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:47:16.340641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:16.340641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:16.340641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:16.340641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:16.340641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:16.340641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:16.340641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:16.340641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:16.340641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:16.340641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:16.340641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:16.340641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:16.340641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:16.341654 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:16.341654 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:16.341654 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:47:16.341654 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:47:16.341654 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:47:16.341654 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:47:16.341654 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:47:16.341654 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:47:16.341654 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:47:16.341654 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:16.341654 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 293/597] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Aug 17 14:47:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:47:16.341654 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff9bc3-2950-4dd1-ba2e-51ad5c2596a0 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:16.389353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846a44f-e1e9-43fa-ba98-c1fd3404f3cd None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:16.422932 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ea55d-f35c-48cb-8eee-beee23c73961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:16.423570 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ea55d-f35c-48cb-8eee-beee23c73961 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:16.423856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ea55d-f35c-48cb-8eee-beee23c73961 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:16.424128 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ea55d-f35c-48cb-8eee-beee23c73961 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:16.424821 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ea55d-f35c-48cb-8eee-beee23c73961 None admin] RBAC: Adding query filter params (name=service) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:16.425125 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ea55d-f35c-48cb-8eee-beee23c73961 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:16.426648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ea55d-f35c-48cb-8eee-beee23c73961 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:16.440432 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 305/598] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 17 14:47:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:16.440432 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ea55d-f35c-48cb-8eee-beee23c73961 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:16.452601 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:16.452782 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:16.461291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff9bc3-2950-4dd1-ba2e-51ad5c2596a0 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:16.502261 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0c614-b76f-4011-ad4e-c170a4f7d6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:16.502878 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0c614-b76f-4011-ad4e-c170a4f7d6cf None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:16.503168 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0c614-b76f-4011-ad4e-c170a4f7d6cf None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:16.503418 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0c614-b76f-4011-ad4e-c170a4f7d6cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:16.515470 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0c614-b76f-4011-ad4e-c170a4f7d6cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:47:16.520231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-9ea0c614-b76f-4011-ad4e-c170a4f7d6cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:16.520231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:16.520231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:16.520231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:16.520231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:16.520231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:16.520231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:16.520231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:16.520231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:16.520231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:16.520231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:16.520231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:16.520231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:47:16.520231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:47:16.520231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:47:16.520231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:47:16.521146 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:47:16.521146 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:47:16.521146 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:47:16.521146 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:47:16.521146 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:16.521146 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:16.521146 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:16.521146 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:16.521146 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:16.521146 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:16.521146 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:16.521146 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:16.521146 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:16.521146 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:16.521146 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:16.521146 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:16.522066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:16.522066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:16.522066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:16.522066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:16.522066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:47:16.522066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:47:16.522066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:47:16.522066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:47:16.522066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:47:16.522066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:47:16.522066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:16.522066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:16.522066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 294/599] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 17 14:47:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:16.522748 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0c614-b76f-4011-ad4e-c170a4f7d6cf None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:16.556492 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ea55d-f35c-48cb-8eee-beee23c73961 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:16.592669 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd58a0-fec3-4be8-aa41-aa44e9d68008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:16.593268 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd58a0-fec3-4be8-aa41-aa44e9d68008 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:16.593544 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd58a0-fec3-4be8-aa41-aa44e9d68008 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:16.593848 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd58a0-fec3-4be8-aa41-aa44e9d68008 None admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:16.594577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd58a0-fec3-4be8-aa41-aa44e9d68008 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:16.594880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd58a0-fec3-4be8-aa41-aa44e9d68008 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:16.596283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd58a0-fec3-4be8-aa41-aa44e9d68008 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:16.614012 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 306/600] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Aug 17 14:47:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:16.614825 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd58a0-fec3-4be8-aa41-aa44e9d68008 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:16.638400 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0c614-b76f-4011-ad4e-c170a4f7d6cf None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:16.671056 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bc737-70f1-4a03-b4b4-03bc37d53b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:16.671666 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bc737-70f1-4a03-b4b4-03bc37d53b3b None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:16.671938 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bc737-70f1-4a03-b4b4-03bc37d53b3b None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:16.672206 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bc737-70f1-4a03-b4b4-03bc37d53b3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:16.682973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bc737-70f1-4a03-b4b4-03bc37d53b3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:16.684521 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bc737-70f1-4a03-b4b4-03bc37d53b3b None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:16.685209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:16.700210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-174bc737-70f1-4a03-b4b4-03bc37d53b3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:16.700210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:16.700210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:16.700210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:16.700210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:16.700210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:16.700210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:16.700210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:16.700210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:16.700210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:16.700210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:16.700210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:16.700210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:16.700210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:16.700210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:16.700210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:16.701257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:16.701257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:16.701257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:16.701257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:16.701257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:16.701257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:16.701257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:16.701257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:16.701257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:16.701257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:16.701257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:16.701257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:16.701257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:16.701257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:16.701257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:16.701257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:16.701257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:16.702153 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:16.702153 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:16.702153 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:16.702153 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 295/601] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:16.702153 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bc737-70f1-4a03-b4b4-03bc37d53b3b None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:16.710859 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:16.717642 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd58a0-fec3-4be8-aa41-aa44e9d68008 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:16.753116 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e353c0a-0e87-4ba4-86d4-9a958195b25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:16.753703 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353c0a-0e87-4ba4-86d4-9a958195b25b None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:16.754002 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353c0a-0e87-4ba4-86d4-9a958195b25b None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:16.754267 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353c0a-0e87-4ba4-86d4-9a958195b25b None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:16.754911 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e353c0a-0e87-4ba4-86d4-9a958195b25b None admin] RBAC: Adding query filter params (name=service) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:16.755204 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e353c0a-0e87-4ba4-86d4-9a958195b25b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:16.756552 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e353c0a-0e87-4ba4-86d4-9a958195b25b None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:16.764461 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 307/602] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 17 14:47:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:16.765235 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e353c0a-0e87-4ba4-86d4-9a958195b25b None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:16.804364 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bc737-70f1-4a03-b4b4-03bc37d53b3b None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:16.838350 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addff332-fd28-44df-a6f2-94d662cfe736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:16.839000 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addff332-fd28-44df-a6f2-94d662cfe736 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:16.839290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addff332-fd28-44df-a6f2-94d662cfe736 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:16.839561 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addff332-fd28-44df-a6f2-94d662cfe736 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:16.850160 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addff332-fd28-44df-a6f2-94d662cfe736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:47:16.855776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-addff332-fd28-44df-a6f2-94d662cfe736 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:16.855776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:16.855776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:16.855776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:16.855776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:16.855776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:16.855776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:16.855776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:16.855776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:16.855776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:16.855776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:16.855776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:16.855776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:47:16.855776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:47:16.855776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:47:16.855776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:47:16.856973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:47:16.856973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:47:16.856973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:47:16.856973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:47:16.856973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:16.856973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:16.856973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:16.856973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:16.856973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:16.856973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:16.856973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:16.856973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:16.856973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:16.856973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:16.856973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:16.856973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:16.858354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:16.858354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:16.858354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:16.858354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:16.858354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:47:16.858354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:47:16.858354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:47:16.858354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:47:16.858354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:47:16.858354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:47:16.858354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:47:16.858354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:16.858354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 296/603] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 17 14:47:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:16.858354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addff332-fd28-44df-a6f2-94d662cfe736 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:16.865934 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e353c0a-0e87-4ba4-86d4-9a958195b25b None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:16.895657 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:16.900936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5e12d-0023-4280-ab05-426d0da4238a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:16.901538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5e12d-0023-4280-ab05-426d0da4238a None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:16.901842 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5e12d-0023-4280-ab05-426d0da4238a None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:16.902105 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5e12d-0023-4280-ab05-426d0da4238a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:16.923319 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:16.959752 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addff332-fd28-44df-a6f2-94d662cfe736 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:16.969895 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5e12d-0023-4280-ab05-426d0da4238a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:16.971638 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5e12d-0023-4280-ab05-426d0da4238a None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:16.994329 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7734efa-7907-4d17-b37e-3f08584d93cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:16.995756 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7734efa-7907-4d17-b37e-3f08584d93cc None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:16.996092 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7734efa-7907-4d17-b37e-3f08584d93cc None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:16.996379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7734efa-7907-4d17-b37e-3f08584d93cc None admin] PATH_INFO: `/v3/domains` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:16.997011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7734efa-7907-4d17-b37e-3f08584d93cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:16.997306 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7734efa-7907-4d17-b37e-3f08584d93cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:16.998680 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7734efa-7907-4d17-b37e-3f08584d93cc None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:17.010379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 297/604] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:17.011300 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7734efa-7907-4d17-b37e-3f08584d93cc None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:17.072327 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 308/605] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:47:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:47:17.073218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5e12d-0023-4280-ab05-426d0da4238a None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:17.102568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:17.116346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7734efa-7907-4d17-b37e-3f08584d93cc None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:17.142093 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:17.150774 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3749f0-fecc-43c4-b7d2-829778592df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:17.152071 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3749f0-fecc-43c4-b7d2-829778592df3 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:17.152403 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3749f0-fecc-43c4-b7d2-829778592df3 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:17.152676 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3749f0-fecc-43c4-b7d2-829778592df3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:17.162741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3749f0-fecc-43c4-b7d2-829778592df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:17.164154 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3749f0-fecc-43c4-b7d2-829778592df3 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:17.171181 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5e12d-0023-4280-ab05-426d0da4238a None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:17.179274 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-8f3749f0-fecc-43c4-b7d2-829778592df3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:17.179274 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:17.179274 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:17.179274 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:17.179274 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:17.179274 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:17.179274 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:17.179274 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:17.179274 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:17.179274 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:17.179274 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:17.179274 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:17.179274 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:17.179274 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:17.179274 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:17.179274 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:17.180373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:17.180373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:17.180373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:17.180373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:17.180373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:17.180373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:17.180373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:17.180373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:17.180373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:17.180373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:17.180373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:17.180373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:17.180373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:17.180373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:17.180373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:17.180373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:17.180373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:17.181644 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:17.181644 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:17.181644 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:17.181644 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 298/606] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:17.181644 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3749f0-fecc-43c4-b7d2-829778592df3 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:17.206256 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9efe4-2db7-4f0c-9e37-18b9957c1b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:17.206850 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9efe4-2db7-4f0c-9e37-18b9957c1b53 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:17.207120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9efe4-2db7-4f0c-9e37-18b9957c1b53 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:17.207384 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9efe4-2db7-4f0c-9e37-18b9957c1b53 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:17.208033 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9efe4-2db7-4f0c-9e37-18b9957c1b53 None admin] RBAC: Adding query filter params (name=service) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:17.208325 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9efe4-2db7-4f0c-9e37-18b9957c1b53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:17.209656 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9efe4-2db7-4f0c-9e37-18b9957c1b53 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:17.217813 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 309/607] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 17 14:47:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:17.218581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9efe4-2db7-4f0c-9e37-18b9957c1b53 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:17.281200 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3749f0-fecc-43c4-b7d2-829778592df3 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:17.309361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:17.314998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c4838-ca17-4aa4-844f-13226da654f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:17.315613 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c4838-ca17-4aa4-844f-13226da654f4 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:17.315914 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c4838-ca17-4aa4-844f-13226da654f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:17.316146 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9efe4-2db7-4f0c-9e37-18b9957c1b53 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:17.316246 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c4838-ca17-4aa4-844f-13226da654f4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:17.323922 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c4838-ca17-4aa4-844f-13226da654f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:17.325311 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c4838-ca17-4aa4-844f-13226da654f4 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:17.336222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-440c4838-ca17-4aa4-844f-13226da654f4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 14:47:17.336222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:17.336222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:17.336222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:17.336222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:17.336222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:17.336222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:17.336222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:17.336222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:17.336222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:17.336222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:17.336222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:17.336222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:47:17.336222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:47:17.336222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:47:17.336222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:47:17.337338 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:17.337338 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:17.337338 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:47:17.337338 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:17.337338 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:47:17.337338 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:17.337338 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:17.337338 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:17.337338 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:17.337338 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:17.337338 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:17.337338 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:17.337338 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:17.337338 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:17.337338 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:17.337338 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:17.337338 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:17.337338 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:17.338327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:17.338327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:17.338327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:47:17.338327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:47:17.338327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:47:17.338327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:47:17.338327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:47:17.338327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:47:17.338327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 14:47:17.338327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:17.338327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 299/608] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:47:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:17.338327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c4838-ca17-4aa4-844f-13226da654f4 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:17.351452 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843599b-5064-4d06-8379-a862c96a2822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:17.352066 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843599b-5064-4d06-8379-a862c96a2822 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:17.352337 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843599b-5064-4d06-8379-a862c96a2822 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:17.352590 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843599b-5064-4d06-8379-a862c96a2822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:17.363894 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6843599b-5064-4d06-8379-a862c96a2822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:17.365329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6843599b-5064-4d06-8379-a862c96a2822 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:17.379371 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-6843599b-5064-4d06-8379-a862c96a2822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:17.379371 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:17.379371 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:17.379371 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:17.379371 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:17.379371 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:17.379371 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:17.379371 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:17.379371 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:17.379371 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:17.379371 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:17.379371 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:17.379371 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:17.379371 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:17.379371 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:17.379371 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:17.380477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:17.380477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:17.380477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:17.380477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:17.380477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:17.380477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:17.380477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:17.380477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:17.380477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:17.380477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:17.380477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:17.380477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:17.380477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:17.380477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:17.380477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:17.380477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:17.380477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:17.381351 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:17.381351 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:17.381351 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:17.381351 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 310/609] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:17.381577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843599b-5064-4d06-8379-a862c96a2822 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:17.383285 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:17.445850 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c4838-ca17-4aa4-844f-13226da654f4 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:17.481428 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1643ae4-6139-486f-978e-7a9c119db072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:17.482064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1643ae4-6139-486f-978e-7a9c119db072 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:17.482348 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1643ae4-6139-486f-978e-7a9c119db072 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:17.482534 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843599b-5064-4d06-8379-a862c96a2822 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:17.482662 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1643ae4-6139-486f-978e-7a9c119db072 None admin] PATH_INFO: `/v3/domains` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:17.483251 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1643ae4-6139-486f-978e-7a9c119db072 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:17.483554 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1643ae4-6139-486f-978e-7a9c119db072 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:17.484929 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1643ae4-6139-486f-978e-7a9c119db072 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:17.497234 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 300/610] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:17.498055 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1643ae4-6139-486f-978e-7a9c119db072 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:17.521241 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d627a5-c017-440b-8f10-85dc5779337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:17.521894 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d627a5-c017-440b-8f10-85dc5779337e None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:17.522172 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d627a5-c017-440b-8f10-85dc5779337e None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:17.522437 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d627a5-c017-440b-8f10-85dc5779337e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:17.533509 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d627a5-c017-440b-8f10-85dc5779337e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:17.534967 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d627a5-c017-440b-8f10-85dc5779337e None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:17.541055 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:17.549572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-94d627a5-c017-440b-8f10-85dc5779337e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:17.549572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:17.549572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:17.549572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:17.549572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:17.549572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:17.549572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:17.549572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:17.549572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:17.549572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:17.549572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:17.549572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:17.549572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:17.549572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:17.549572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:17.549572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:17.550727 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:17.550727 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:17.550727 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:17.550727 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:17.550727 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:17.550727 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:17.550727 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:17.550727 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:17.550727 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:17.550727 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:17.550727 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:17.550727 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:17.550727 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:17.550727 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:17.550727 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:17.550727 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:17.550727 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:17.551603 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:17.551603 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:17.551603 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:17.551603 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 311/611] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:17.551603 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d627a5-c017-440b-8f10-85dc5779337e None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:17.603074 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:17.607936 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1643ae4-6139-486f-978e-7a9c119db072 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:17.642825 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fb06c-20b0-4f4c-bece-e8780ad1fb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:17.643428 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fb06c-20b0-4f4c-bece-e8780ad1fb62 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:17.643701 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fb06c-20b0-4f4c-bece-e8780ad1fb62 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:17.643971 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fb06c-20b0-4f4c-bece-e8780ad1fb62 None admin] PATH_INFO: `/v3/users` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:17.644691 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fb06c-20b0-4f4c-bece-e8780ad1fb62 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:17.644991 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fb06c-20b0-4f4c-bece-e8780ad1fb62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:17.646441 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fb06c-20b0-4f4c-bece-e8780ad1fb62 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:17.656177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d627a5-c017-440b-8f10-85dc5779337e None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:17.664179 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 301/612] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Aug 17 14:47:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:17.664997 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fb06c-20b0-4f4c-bece-e8780ad1fb62 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:17.690944 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc43f2-cc68-4268-b88e-f615f59b21fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:17.691542 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc43f2-cc68-4268-b88e-f615f59b21fb None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:17.691817 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc43f2-cc68-4268-b88e-f615f59b21fb None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:17.692085 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc43f2-cc68-4268-b88e-f615f59b21fb None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:17.692718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc43f2-cc68-4268-b88e-f615f59b21fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:17.693013 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc43f2-cc68-4268-b88e-f615f59b21fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:17.694385 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc43f2-cc68-4268-b88e-f615f59b21fb None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:17.706206 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 312/613] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:17.706980 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc43f2-cc68-4268-b88e-f615f59b21fb None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:17.763597 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:17.768635 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fb06c-20b0-4f4c-bece-e8780ad1fb62 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:17.803234 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f96be-c415-433b-8b15-867068ccc78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:17.803850 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f96be-c415-433b-8b15-867068ccc78c None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:17.804127 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f96be-c415-433b-8b15-867068ccc78c None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:17.804393 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f96be-c415-433b-8b15-867068ccc78c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:17.805630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc43f2-cc68-4268-b88e-f615f59b21fb None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:17.811309 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f96be-c415-433b-8b15-867068ccc78c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:17.812726 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f96be-c415-433b-8b15-867068ccc78c None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:17.823917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-552f96be-c415-433b-8b15-867068ccc78c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 14:47:17.823917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:17.823917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:17.823917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:17.823917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:17.823917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:17.823917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:17.823917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:17.823917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:17.823917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:17.823917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:17.823917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:17.823917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:47:17.823917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:47:17.823917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:47:17.823917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:47:17.825023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:17.825023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:17.825023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:47:17.825023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:17.825023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:47:17.825023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:17.825023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:17.825023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:17.825023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:17.825023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:17.825023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:17.825023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:17.825023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:17.825023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:17.825023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:17.825023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:17.825023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:17.825023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:17.826301 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:17.826301 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:17.826301 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:47:17.826301 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:47:17.826301 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:47:17.826301 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:47:17.826301 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:47:17.826301 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:47:17.826301 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 14:47:17.826301 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:17.829576 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 302/614] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:47:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:17.830461 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f96be-c415-433b-8b15-867068ccc78c None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:17.843255 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47702055-7a22-4a37-969a-ecfaa56620e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:17.844011 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47702055-7a22-4a37-969a-ecfaa56620e4 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:17.844288 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47702055-7a22-4a37-969a-ecfaa56620e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:17.844559 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47702055-7a22-4a37-969a-ecfaa56620e4 None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:17.845200 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47702055-7a22-4a37-969a-ecfaa56620e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:17.845498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47702055-7a22-4a37-969a-ecfaa56620e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:17.846886 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47702055-7a22-4a37-969a-ecfaa56620e4 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:17.848485 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:17.863969 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 313/615] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:17.863969 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47702055-7a22-4a37-969a-ecfaa56620e4 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:17.936992 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f96be-c415-433b-8b15-867068ccc78c None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:17.957577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47702055-7a22-4a37-969a-ecfaa56620e4 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:17.970347 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b26d2-240e-4729-8d23-e992f414e4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:17.970944 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b26d2-240e-4729-8d23-e992f414e4ec None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:17.971231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b26d2-240e-4729-8d23-e992f414e4ec None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:17.971498 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b26d2-240e-4729-8d23-e992f414e4ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:17.974217 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:17.991818 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222ac73-ec63-431b-9122-ef20e15df3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:17.992426 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222ac73-ec63-431b-9122-ef20e15df3a6 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:17.992703 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222ac73-ec63-431b-9122-ef20e15df3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:17.992968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222ac73-ec63-431b-9122-ef20e15df3a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:18.000738 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222ac73-ec63-431b-9122-ef20e15df3a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:18.002257 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222ac73-ec63-431b-9122-ef20e15df3a6 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:18.014877 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-6222ac73-ec63-431b-9122-ef20e15df3a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:18.014877 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:18.014877 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:18.014877 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:18.014877 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:18.014877 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:18.014877 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:18.014877 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:18.014877 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:18.014877 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:18.014877 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:18.014877 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:18.014877 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:47:18.014877 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:47:18.014877 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:47:18.016021 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:47:18.016021 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:18.016021 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:18.016021 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:18.016021 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:18.016021 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:18.016021 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:18.016021 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:18.016021 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:18.016021 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:18.016021 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:18.016021 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:18.016021 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:18.016021 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:18.016021 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:18.016021 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:18.016021 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:18.017308 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:47:18.017308 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:47:18.017308 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:47:18.017308 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:47:18.017308 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:47:18.017308 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:47:18.017308 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:18.017308 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:18.017308 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 314/616] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:18.017308 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222ac73-ec63-431b-9122-ef20e15df3a6 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:18.046816 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b26d2-240e-4729-8d23-e992f414e4ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:18.048258 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b26d2-240e-4729-8d23-e992f414e4ec None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:18.065844 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:18.123198 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222ac73-ec63-431b-9122-ef20e15df3a6 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:18.149882 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 303/617] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:47:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:47:18.150724 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b26d2-240e-4729-8d23-e992f414e4ec None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:18.160537 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9412d78-27ad-4642-821b-f8283ae1c4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:18.161165 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9412d78-27ad-4642-821b-f8283ae1c4a5 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:18.161445 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9412d78-27ad-4642-821b-f8283ae1c4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:18.161719 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9412d78-27ad-4642-821b-f8283ae1c4a5 None admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:18.162466 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9412d78-27ad-4642-821b-f8283ae1c4a5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:18.162766 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9412d78-27ad-4642-821b-f8283ae1c4a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:18.164218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9412d78-27ad-4642-821b-f8283ae1c4a5 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:18.182702 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 315/618] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Aug 17 14:47:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:18.183499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9412d78-27ad-4642-821b-f8283ae1c4a5 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:18.220870 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:18.252724 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b26d2-240e-4729-8d23-e992f414e4ec None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:18.270108 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:18.289651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81529fce-4185-42da-aefb-d9930a247e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:18.290305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81529fce-4185-42da-aefb-d9930a247e30 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:18.290585 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81529fce-4185-42da-aefb-d9930a247e30 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:18.290859 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81529fce-4185-42da-aefb-d9930a247e30 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:18.292289 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9412d78-27ad-4642-821b-f8283ae1c4a5 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:18.298507 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81529fce-4185-42da-aefb-d9930a247e30 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:18.299954 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81529fce-4185-42da-aefb-d9930a247e30 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:18.312214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-81529fce-4185-42da-aefb-d9930a247e30 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 14:47:18.312214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:18.312214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:18.312214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:18.312214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:18.312214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:18.312214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:18.312214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:18.312214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:18.312214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:18.312214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:18.312214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:18.312214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:47:18.312214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:47:18.312214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:47:18.312214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:47:18.313288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:18.313288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:18.313288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:47:18.313288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:18.313288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:47:18.313288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:18.313288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:18.313288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:18.313288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:18.313288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:18.313288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:18.313288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:18.313288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:18.313288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:18.313288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:18.313288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:18.313288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:18.313288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:18.314419 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:18.314419 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:18.314419 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:47:18.314419 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:47:18.314419 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:47:18.314419 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:47:18.314419 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:47:18.314419 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:47:18.314419 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 14:47:18.314419 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:18.314419 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 304/619] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 17 14:47:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:18.314419 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81529fce-4185-42da-aefb-d9930a247e30 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:18.328133 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fed1ae-a746-4b44-b190-1cd8469fb617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:18.328734 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fed1ae-a746-4b44-b190-1cd8469fb617 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:18.329011 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fed1ae-a746-4b44-b190-1cd8469fb617 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:18.329277 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fed1ae-a746-4b44-b190-1cd8469fb617 None admin] PATH_INFO: `/v3/projects` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:18.330001 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fed1ae-a746-4b44-b190-1cd8469fb617 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:18.330303 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fed1ae-a746-4b44-b190-1cd8469fb617 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:18.331718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fed1ae-a746-4b44-b190-1cd8469fb617 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:18.343195 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 316/620] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:47:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:18.343976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fed1ae-a746-4b44-b190-1cd8469fb617 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:18.420510 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81529fce-4185-42da-aefb-d9930a247e30 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:18.436402 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:18.442710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fed1ae-a746-4b44-b190-1cd8469fb617 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:18.457899 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8ed99-5b94-4fb6-835b-caaf0d322d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:18.458611 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8ed99-5b94-4fb6-835b-caaf0d322d0b None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:18.458889 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8ed99-5b94-4fb6-835b-caaf0d322d0b None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:18.459163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8ed99-5b94-4fb6-835b-caaf0d322d0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:18.470123 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8ed99-5b94-4fb6-835b-caaf0d322d0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:18.471551 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8ed99-5b94-4fb6-835b-caaf0d322d0b None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:18.480305 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687476a9-5440-41ed-9ab9-3627d182daed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:18.480892 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687476a9-5440-41ed-9ab9-3627d182daed None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:18.481165 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687476a9-5440-41ed-9ab9-3627d182daed None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:18.481433 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687476a9-5440-41ed-9ab9-3627d182daed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:18.485851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-21c8ed99-5b94-4fb6-835b-caaf0d322d0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:18.485851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:18.485851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:18.485851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:18.485851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:18.485851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:18.485851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:18.485851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:18.485851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:18.485851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:18.485851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:18.485851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:18.485851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:18.485851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:18.485851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:18.485851 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:18.486807 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:18.486807 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:18.486807 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:18.486807 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:18.486807 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:18.486807 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:18.486807 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:18.486807 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:18.486807 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:18.486807 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:18.486807 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:18.486807 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:18.486807 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:18.486807 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:18.486807 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:18.486807 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:18.486807 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:18.487689 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:18.487689 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:18.487689 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:18.487689 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 305/621] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:18.487689 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8ed99-5b94-4fb6-835b-caaf0d322d0b None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:18.519377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:18.551807 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687476a9-5440-41ed-9ab9-3627d182daed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:18.553453 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687476a9-5440-41ed-9ab9-3627d182daed None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:18.599447 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8ed99-5b94-4fb6-835b-caaf0d322d0b None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:18.633106 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43aa6b-6fff-4ac7-aca9-cce41d991508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:18.633705 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43aa6b-6fff-4ac7-aca9-cce41d991508 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:18.634007 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43aa6b-6fff-4ac7-aca9-cce41d991508 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:18.634281 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43aa6b-6fff-4ac7-aca9-cce41d991508 None admin] PATH_INFO: `/v3/users` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:18.634999 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43aa6b-6fff-4ac7-aca9-cce41d991508 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:18.636189 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43aa6b-6fff-4ac7-aca9-cce41d991508 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:18.637602 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43aa6b-6fff-4ac7-aca9-cce41d991508 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:18.646656 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:18.653861 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 317/622] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:47:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:47:18.654432 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 306/623] 10.222.0.30 () {56 vars in 1139 bytes} [Wed Aug 17 14:47:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:18.654944 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687476a9-5440-41ed-9ab9-3627d182daed None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:18.655232 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43aa6b-6fff-4ac7-aca9-cce41d991508 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:18.737825 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:18.752619 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687476a9-5440-41ed-9ab9-3627d182daed None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:18.754227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43aa6b-6fff-4ac7-aca9-cce41d991508 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:18.785565 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29c214-9efa-4de1-b5ee-7fdcda26771c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:18.786185 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29c214-9efa-4de1-b5ee-7fdcda26771c None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:18.786458 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29c214-9efa-4de1-b5ee-7fdcda26771c None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:18.786721 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29c214-9efa-4de1-b5ee-7fdcda26771c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:18.787428 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29c214-9efa-4de1-b5ee-7fdcda26771c None admin] RBAC: Adding query filter params (role.id=cb99a767f5264f2dace0994d13d0fbc8, scope.project.id=e9d40280440c4d25b6d60a431d6f788b, user.id=8aca6a001d3b479bab684772768d49f5) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:18.787726 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29c214-9efa-4de1-b5ee-7fdcda26771c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:18.788208 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c818c2-3198-4ba9-96e5-db83b1179490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:18.788808 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c818c2-3198-4ba9-96e5-db83b1179490 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:18.789089 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c818c2-3198-4ba9-96e5-db83b1179490 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:18.789179 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29c214-9efa-4de1-b5ee-7fdcda26771c None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:18.789361 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c818c2-3198-4ba9-96e5-db83b1179490 None admin] PATH_INFO: `/v3/domains` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:18.790060 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c818c2-3198-4ba9-96e5-db83b1179490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:18.790363 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c818c2-3198-4ba9-96e5-db83b1179490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:18.792619 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c818c2-3198-4ba9-96e5-db83b1179490 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:18.794982 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 318/624] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:47:18 2022] GET /identity/v3/role_assignments?user.id=8aca6a001d3b479bab684772768d49f5&scope.project.id=e9d40280440c4d25b6d60a431d6f788b&role.id=cb99a767f5264f2dace0994d13d0fbc8 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:18.795746 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29c214-9efa-4de1-b5ee-7fdcda26771c None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:18.817298 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 307/625] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:18.818036 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c818c2-3198-4ba9-96e5-db83b1179490 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:18.862231 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:18.913249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29c214-9efa-4de1-b5ee-7fdcda26771c None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:18.935841 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c818c2-3198-4ba9-96e5-db83b1179490 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:18.952923 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16339e0-656e-4687-91f1-5e18a3f250be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:18.953648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16339e0-656e-4687-91f1-5e18a3f250be None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:18.953869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16339e0-656e-4687-91f1-5e18a3f250be None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:18.954097 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16339e0-656e-4687-91f1-5e18a3f250be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:18.976701 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e73257-53dd-4aec-8209-fb797a6d5a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:18.977384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e73257-53dd-4aec-8209-fb797a6d5a4a None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:18.977612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e73257-53dd-4aec-8209-fb797a6d5a4a None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:18.977918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e73257-53dd-4aec-8209-fb797a6d5a4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:18.990805 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e73257-53dd-4aec-8209-fb797a6d5a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:18.992184 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e73257-53dd-4aec-8209-fb797a6d5a4a None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:19.001841 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:19.011276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-42e73257-53dd-4aec-8209-fb797a6d5a4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:19.011276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:19.011276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:19.011276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:19.011276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:19.011276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:19.011276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:19.011276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:19.011276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:19.011276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:19.011276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:19.011276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:19.011276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:19.011276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:19.011276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:19.011276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:19.012371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:19.012371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:19.012371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:19.012371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:19.012371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:19.012371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:19.012371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:19.012371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:19.012371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:19.012371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:19.012371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:19.012371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:19.012371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:19.012371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:19.012371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:19.012371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:19.012371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:19.013431 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:19.013431 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:19.013431 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:19.013431 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 308/626] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:19.014827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e73257-53dd-4aec-8209-fb797a6d5a4a None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:19.034742 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16339e0-656e-4687-91f1-5e18a3f250be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:19.036205 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16339e0-656e-4687-91f1-5e18a3f250be None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:19.102323 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:19.133033 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e73257-53dd-4aec-8209-fb797a6d5a4a None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:19.147231 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 319/627] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:47:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:47:19.148621 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16339e0-656e-4687-91f1-5e18a3f250be None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:19.176946 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d30d7-d688-402e-908c-c0d34335c173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:19.177573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d30d7-d688-402e-908c-c0d34335c173 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:19.177883 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d30d7-d688-402e-908c-c0d34335c173 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:19.178153 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d30d7-d688-402e-908c-c0d34335c173 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:19.185201 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d30d7-d688-402e-908c-c0d34335c173 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:19.186668 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d30d7-d688-402e-908c-c0d34335c173 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:19.198549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-c27d30d7-d688-402e-908c-c0d34335c173 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:19.198549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:19.198549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:19.198549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:19.198549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:19.198549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:19.198549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:19.198549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:19.198549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:19.198549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:19.198549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:19.198549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:19.198549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:47:19.198549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:47:19.198549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:47:19.199665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:47:19.199665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:19.199665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:19.199665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:19.199665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:19.199665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:19.199665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:19.199665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:19.199665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:19.199665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:19.199665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:19.199665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:19.199665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:19.199665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:19.199665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:19.199665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:19.199665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:19.200736 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:47:19.200736 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:47:19.200736 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:47:19.200736 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:47:19.200736 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:47:19.200736 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:47:19.200736 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:19.200736 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:19.204381 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 309/628] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:19.205100 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d30d7-d688-402e-908c-c0d34335c173 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:19.260783 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16339e0-656e-4687-91f1-5e18a3f250be None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:19.267874 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:19.305361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9104c-c131-4322-9b41-10568313f4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:19.306005 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9104c-c131-4322-9b41-10568313f4d7 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:19.306282 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9104c-c131-4322-9b41-10568313f4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:19.306550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9104c-c131-4322-9b41-10568313f4d7 None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:19.307234 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9104c-c131-4322-9b41-10568313f4d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:19.307550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9104c-c131-4322-9b41-10568313f4d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:19.309053 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9104c-c131-4322-9b41-10568313f4d7 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:19.321603 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 320/629] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:19.323084 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9104c-c131-4322-9b41-10568313f4d7 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:19.327061 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d30d7-d688-402e-908c-c0d34335c173 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:19.349913 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:19.372931 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae75ed8-4dec-4423-8112-b05035857ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:19.373997 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae75ed8-4dec-4423-8112-b05035857ffa None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:19.374524 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae75ed8-4dec-4423-8112-b05035857ffa None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:19.375010 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae75ed8-4dec-4423-8112-b05035857ffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:19.393661 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae75ed8-4dec-4423-8112-b05035857ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:19.395174 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae75ed8-4dec-4423-8112-b05035857ffa None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:19.410171 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-7ae75ed8-4dec-4423-8112-b05035857ffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:19.410171 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:19.410171 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:19.410171 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:19.410171 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:19.410171 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:19.410171 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:19.410171 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:19.410171 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:19.410171 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:19.410171 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:19.410171 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:19.410171 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:19.410171 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:19.410171 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:19.410171 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:19.411299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:19.411299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:19.411299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:19.411299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:19.411299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:19.411299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:19.411299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:19.411299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:19.411299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:19.411299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:19.411299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:19.411299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:19.411299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:19.411299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:19.411299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:19.411299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:19.411299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:19.412355 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:19.412355 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:19.412355 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:19.415964 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 310/630] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:19.417434 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae75ed8-4dec-4423-8112-b05035857ffa None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:19.451709 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9104c-c131-4322-9b41-10568313f4d7 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:19.488921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe60abe-56ec-4920-8bc3-18c9b47ad08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:19.489527 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe60abe-56ec-4920-8bc3-18c9b47ad08d None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:19.489835 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe60abe-56ec-4920-8bc3-18c9b47ad08d None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:19.490112 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe60abe-56ec-4920-8bc3-18c9b47ad08d None admin] PATH_INFO: `/v3/projects` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:19.490793 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe60abe-56ec-4920-8bc3-18c9b47ad08d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:19.491096 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe60abe-56ec-4920-8bc3-18c9b47ad08d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:19.492504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe60abe-56ec-4920-8bc3-18c9b47ad08d None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:19.509435 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 321/631] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:47:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:19.509435 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe60abe-56ec-4920-8bc3-18c9b47ad08d None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:19.533822 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae75ed8-4dec-4423-8112-b05035857ffa None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:19.546336 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:19.577444 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773f909-184c-429c-bd58-93c7d5c8a528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:19.578093 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773f909-184c-429c-bd58-93c7d5c8a528 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:19.578364 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773f909-184c-429c-bd58-93c7d5c8a528 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:19.578632 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773f909-184c-429c-bd58-93c7d5c8a528 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:19.586291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773f909-184c-429c-bd58-93c7d5c8a528 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:19.587724 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773f909-184c-429c-bd58-93c7d5c8a528 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:19.596636 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:19.600517 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-f773f909-184c-429c-bd58-93c7d5c8a528 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:19.600517 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:19.600517 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:19.600517 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:19.600517 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:19.600517 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:19.600517 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:19.600517 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:19.600517 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:19.600517 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:19.600517 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:19.600517 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:19.600517 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:47:19.600517 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:47:19.600517 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:47:19.601522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:47:19.601522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:19.601522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:19.601522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:19.601522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:19.601522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:19.601522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:19.601522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:19.601522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:19.601522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:19.601522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:19.601522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:19.601522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:19.601522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:19.601522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:19.601522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:19.601522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:19.608205 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:47:19.608205 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:47:19.608205 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:47:19.608205 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:47:19.608205 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:47:19.608205 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:47:19.608205 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:19.608205 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:19.608205 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 311/632] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:19.608205 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773f909-184c-429c-bd58-93c7d5c8a528 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:19.628666 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe60abe-56ec-4920-8bc3-18c9b47ad08d None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:19.666096 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a20b09-a51d-4b25-9b5d-706c882c0dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:19.666777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a20b09-a51d-4b25-9b5d-706c882c0dab None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:19.667112 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a20b09-a51d-4b25-9b5d-706c882c0dab None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:19.667387 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a20b09-a51d-4b25-9b5d-706c882c0dab None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:19.668023 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a20b09-a51d-4b25-9b5d-706c882c0dab None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:19.668320 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a20b09-a51d-4b25-9b5d-706c882c0dab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:19.669786 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a20b09-a51d-4b25-9b5d-706c882c0dab None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:19.681416 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 322/633] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:19.682070 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a20b09-a51d-4b25-9b5d-706c882c0dab None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:19.718553 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773f909-184c-429c-bd58-93c7d5c8a528 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:19.759531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8463377-ccff-47da-85a8-2323059a1497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:19.760678 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8463377-ccff-47da-85a8-2323059a1497 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:19.761042 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8463377-ccff-47da-85a8-2323059a1497 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:19.761586 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8463377-ccff-47da-85a8-2323059a1497 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:19.762163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8463377-ccff-47da-85a8-2323059a1497 None admin] RBAC: Adding query filter params (role.id=cb99a767f5264f2dace0994d13d0fbc8, scope.project.id=e9d40280440c4d25b6d60a431d6f788b, user.id=272278199c5149a1ad326f22ef11f4e1) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:19.762475 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8463377-ccff-47da-85a8-2323059a1497 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:19.763896 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8463377-ccff-47da-85a8-2323059a1497 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:19.778078 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 312/634] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:47:19 2022] GET /identity/v3/role_assignments?user.id=272278199c5149a1ad326f22ef11f4e1&scope.project.id=e9d40280440c4d25b6d60a431d6f788b&role.id=cb99a767f5264f2dace0994d13d0fbc8 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:19.778078 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8463377-ccff-47da-85a8-2323059a1497 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:19.816611 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a20b09-a51d-4b25-9b5d-706c882c0dab None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:19.838186 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:19.869609 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3b303-d679-4648-b21b-8861ead76b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:19.871118 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3b303-d679-4648-b21b-8861ead76b8a None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:19.871344 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3b303-d679-4648-b21b-8861ead76b8a None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:19.871617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3b303-d679-4648-b21b-8861ead76b8a None admin] PATH_INFO: `/v3/projects` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:19.873368 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3b303-d679-4648-b21b-8861ead76b8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:19.873682 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3b303-d679-4648-b21b-8861ead76b8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:19.875232 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3b303-d679-4648-b21b-8861ead76b8a None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:19.890442 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:19.894940 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 323/635] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:47:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:19.901634 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3b303-d679-4648-b21b-8861ead76b8a None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:19.919125 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8463377-ccff-47da-85a8-2323059a1497 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:19.959478 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb2a21-4254-42c2-8ae6-654c609ef7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:19.960420 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb2a21-4254-42c2-8ae6-654c609ef7c1 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:19.960878 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb2a21-4254-42c2-8ae6-654c609ef7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:19.961327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb2a21-4254-42c2-8ae6-654c609ef7c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:19.970155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb2a21-4254-42c2-8ae6-654c609ef7c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:19.972865 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb2a21-4254-42c2-8ae6-654c609ef7c1 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:19.987263 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-e7fb2a21-4254-42c2-8ae6-654c609ef7c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:19.987263 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:19.987263 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:19.987263 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:19.987263 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:19.987263 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:19.987263 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:19.987263 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:19.987263 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:19.987263 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:19.987263 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:19.987263 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:19.987263 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:47:19.987263 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:47:19.987263 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:47:19.991616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:47:19.991616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:19.991616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:19.991616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:19.991616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:19.991616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:19.991616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:19.991616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:19.991616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:19.991616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:19.991616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:19.991616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:19.991616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:19.991616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:19.991616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:19.991616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:19.991616 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:19.992531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:47:19.992531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:47:19.992531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:47:19.992531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:47:19.992531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:47:19.992531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:47:19.992531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:19.992531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:19.992531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 313/636] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:19.996176 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb2a21-4254-42c2-8ae6-654c609ef7c1 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:20.018401 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3b303-d679-4648-b21b-8861ead76b8a None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:20.069246 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3e00b-8e53-417a-83cb-f97c7967ad20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:20.069832 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3e00b-8e53-417a-83cb-f97c7967ad20 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:20.070117 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3e00b-8e53-417a-83cb-f97c7967ad20 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:20.070387 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3e00b-8e53-417a-83cb-f97c7967ad20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:20.071111 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3e00b-8e53-417a-83cb-f97c7967ad20 None admin] RBAC: Adding query filter params (role.id=cb99a767f5264f2dace0994d13d0fbc8, scope.project.id=e9d40280440c4d25b6d60a431d6f788b, user.id=1dacf10fc91547788a9f8bbedfa0f553) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:20.071420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3e00b-8e53-417a-83cb-f97c7967ad20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:20.073250 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3e00b-8e53-417a-83cb-f97c7967ad20 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:20.080090 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 324/637] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:47:19 2022] GET /identity/v3/role_assignments?user.id=1dacf10fc91547788a9f8bbedfa0f553&scope.project.id=e9d40280440c4d25b6d60a431d6f788b&role.id=cb99a767f5264f2dace0994d13d0fbc8 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:47:20.121877 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:20.130266 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb2a21-4254-42c2-8ae6-654c609ef7c1 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:20.171516 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab731b-5cd1-401c-9b7d-981ce0f7767d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:20.172206 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab731b-5cd1-401c-9b7d-981ce0f7767d None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:20.172478 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab731b-5cd1-401c-9b7d-981ce0f7767d None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:20.172753 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab731b-5cd1-401c-9b7d-981ce0f7767d None admin] PATH_INFO: `/v3/projects` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:20.173464 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab731b-5cd1-401c-9b7d-981ce0f7767d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:20.173805 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab731b-5cd1-401c-9b7d-981ce0f7767d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:20.175268 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab731b-5cd1-401c-9b7d-981ce0f7767d None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:20.190459 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 314/638] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:47:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:47:20.196496 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3e00b-8e53-417a-83cb-f97c7967ad20 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:20.270121 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:20.312167 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3e00b-8e53-417a-83cb-f97c7967ad20 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:20.347578 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb484f4-ec04-4459-a48b-cf164c2ece8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:20.348108 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb484f4-ec04-4459-a48b-cf164c2ece8c None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:20.348381 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb484f4-ec04-4459-a48b-cf164c2ece8c None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:20.348649 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb484f4-ec04-4459-a48b-cf164c2ece8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:20.349359 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb484f4-ec04-4459-a48b-cf164c2ece8c None admin] RBAC: Adding query filter params (role.id=cb99a767f5264f2dace0994d13d0fbc8, scope.project.id=e9d40280440c4d25b6d60a431d6f788b, user.id=1e4147647f54499ba24b50fbecc5d38f) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:20.349714 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb484f4-ec04-4459-a48b-cf164c2ece8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:20.351671 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb484f4-ec04-4459-a48b-cf164c2ece8c None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:20.358495 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 325/639] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:47:20 2022] GET /identity/v3/role_assignments?user.id=1e4147647f54499ba24b50fbecc5d38f&scope.project.id=e9d40280440c4d25b6d60a431d6f788b&role.id=cb99a767f5264f2dace0994d13d0fbc8 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:21.098837 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d66c7-7f5f-4b8e-9f66-efe898b21133 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:21.099144 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d66c7-7f5f-4b8e-9f66-efe898b21133 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:21.099382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d66c7-7f5f-4b8e-9f66-efe898b21133 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:21.100973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 315/640] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:21.106566 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d017672-08c4-4146-8327-f47b60da5b3b None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:21.106850 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d017672-08c4-4146-8327-f47b60da5b3b None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:21.107124 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d017672-08c4-4146-8327-f47b60da5b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:21.129347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-2d017672-08c4-4146-8327-f47b60da5b3b None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:21.130834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-2d017672-08c4-4146-8327-f47b60da5b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:21.201500 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 326/641] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:47:21.545494 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d66c7-7f5f-4b8e-9f66-efe898b21133 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:21.661108 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d66c7-7f5f-4b8e-9f66-efe898b21133 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:21.698765 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db818a8-6b00-4bb9-a0ac-bd90e35230fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:21.699384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db818a8-6b00-4bb9-a0ac-bd90e35230fe None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:21.699663 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db818a8-6b00-4bb9-a0ac-bd90e35230fe None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:21.699935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db818a8-6b00-4bb9-a0ac-bd90e35230fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:21.710917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db818a8-6b00-4bb9-a0ac-bd90e35230fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:47:21.716297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-9db818a8-6b00-4bb9-a0ac-bd90e35230fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:47:21.716297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:21.716297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:21.716297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:21.716297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:21.716297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:21.716297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:21.716297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:21.716297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:21.716297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:21.716297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:21.716297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:21.716297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:47:21.716297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:47:21.716297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:47:21.716297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:47:21.717308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:47:21.717308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:47:21.717308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:47:21.717308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:47:21.717308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:21.717308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:21.717308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:21.717308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:21.717308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:21.717308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:21.717308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:21.717308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:21.717308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:21.717308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:21.717308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:21.717308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:21.718227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:21.718227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:21.718227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:21.718227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:21.718227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:47:21.718227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:47:21.718227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:47:21.718227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:47:21.718227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:47:21.718227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:47:21.718227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:47:21.718227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:21.718227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 316/642] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 17 14:47:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:21.723625 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d017672-08c4-4146-8327-f47b60da5b3b None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:21.789506 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:21.835394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d017672-08c4-4146-8327-f47b60da5b3b None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:21.872983 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f06b53-6920-479a-a0d1-0996e91b3e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:21.873592 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f06b53-6920-479a-a0d1-0996e91b3e86 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:21.873905 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f06b53-6920-479a-a0d1-0996e91b3e86 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:21.874180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f06b53-6920-479a-a0d1-0996e91b3e86 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:21.874848 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f06b53-6920-479a-a0d1-0996e91b3e86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:21.875149 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f06b53-6920-479a-a0d1-0996e91b3e86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:21.876507 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f06b53-6920-479a-a0d1-0996e91b3e86 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:21.885960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 327/643] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:47:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:21.891827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db818a8-6b00-4bb9-a0ac-bd90e35230fe None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:21.909781 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:22.008464 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db818a8-6b00-4bb9-a0ac-bd90e35230fe None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:22.048363 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450384e-c7d3-4d92-a132-563595a2ea41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:22.048993 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450384e-c7d3-4d92-a132-563595a2ea41 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:22.049272 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450384e-c7d3-4d92-a132-563595a2ea41 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:22.049552 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450384e-c7d3-4d92-a132-563595a2ea41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:22.061674 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450384e-c7d3-4d92-a132-563595a2ea41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:22.063239 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450384e-c7d3-4d92-a132-563595a2ea41 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:22.079212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-c450384e-c7d3-4d92-a132-563595a2ea41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:22.079212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:22.079212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:22.079212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:22.079212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:22.079212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:22.079212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:22.079212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:22.079212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:22.079212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:22.079212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:22.079212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:22.079212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:22.079212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:22.079212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:22.079212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:22.081325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:22.081325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:22.081325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:22.081325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:22.081325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:22.081325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:22.081325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:22.081325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:22.081325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:22.081325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:22.081325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:22.081325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:22.081325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:22.081325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:22.081325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:22.081325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:22.081325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:22.083412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:22.083412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:22.083412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:22.083412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 317/644] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:22.086237 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f06b53-6920-479a-a0d1-0996e91b3e86 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:22.149715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba03146-0131-417a-bba3-55f09ae4b149 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:22.150057 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba03146-0131-417a-bba3-55f09ae4b149 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:22.150301 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba03146-0131-417a-bba3-55f09ae4b149 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:22.153335 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 318/645] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:22.160445 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47106752-1275-48dd-8c08-5d0ca4cb2abd None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:22.160705 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47106752-1275-48dd-8c08-5d0ca4cb2abd None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:22.160981 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47106752-1275-48dd-8c08-5d0ca4cb2abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:22.187547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-47106752-1275-48dd-8c08-5d0ca4cb2abd None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:22.189406 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-47106752-1275-48dd-8c08-5d0ca4cb2abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:22.205432 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f06b53-6920-479a-a0d1-0996e91b3e86 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:22.227862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:22.248044 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a5922-6676-40ba-9c20-dec065a6c369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:22.249090 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a5922-6676-40ba-9c20-dec065a6c369 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:22.249625 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a5922-6676-40ba-9c20-dec065a6c369 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:22.250121 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a5922-6676-40ba-9c20-dec065a6c369 None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:22.251073 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a5922-6676-40ba-9c20-dec065a6c369 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:22.251594 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a5922-6676-40ba-9c20-dec065a6c369 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:22.253359 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a5922-6676-40ba-9c20-dec065a6c369 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:22.267834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 328/646] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:22.273360 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a5922-6676-40ba-9c20-dec065a6c369 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:22.283586 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:22.297859 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 319/647] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:47:22.391699 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a5922-6676-40ba-9c20-dec065a6c369 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:22.404592 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39607b24-67dc-48db-813a-b71172936135 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:22.405182 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39607b24-67dc-48db-813a-b71172936135 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:22.405644 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39607b24-67dc-48db-813a-b71172936135 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:22.407280 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 320/648] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:22.413019 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886a982-bcbb-4df5-b307-6358e605a5bb None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:22.413304 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886a982-bcbb-4df5-b307-6358e605a5bb None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:22.413578 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886a982-bcbb-4df5-b307-6358e605a5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:22.431605 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750799a-efdf-4103-b178-551d9ba676ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:22.432900 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750799a-efdf-4103-b178-551d9ba676ae None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:22.433364 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750799a-efdf-4103-b178-551d9ba676ae None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:22.433870 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750799a-efdf-4103-b178-551d9ba676ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:22.436459 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-9886a982-bcbb-4df5-b307-6358e605a5bb None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:22.438280 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-9886a982-bcbb-4df5-b307-6358e605a5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:22.447298 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750799a-efdf-4103-b178-551d9ba676ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:22.449662 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750799a-efdf-4103-b178-551d9ba676ae None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:22.467347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-5750799a-efdf-4103-b178-551d9ba676ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:47:22.467347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:22.467347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:22.467347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:22.467347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:22.467347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:22.467347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:22.467347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:22.467347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:22.467347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:22.467347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:22.467347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:22.467347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:47:22.467347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:47:22.467347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:47:22.467347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:47:22.468317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:22.468317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:22.468317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:47:22.468317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:22.468317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:47:22.468317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:22.468317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:22.468317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:22.468317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:22.468317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:22.468317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:22.468317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:22.468317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:22.468317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:22.468317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:22.468317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:22.468317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:22.468317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:22.469258 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:22.469258 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:22.469258 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:47:22.469258 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:47:22.469258 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:47:22.469258 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:47:22.469258 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:47:22.469258 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:47:22.469258 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:47:22.469258 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:22.471116 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 329/649] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Aug 17 14:47:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:22.476838 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750799a-efdf-4103-b178-551d9ba676ae None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:22.540903 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:22.541109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 321/650] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:47:22.601694 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750799a-efdf-4103-b178-551d9ba676ae None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:22.641243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac05ad-a0d0-4a8a-bcfd-6d7f5eca9acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:22.642299 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac05ad-a0d0-4a8a-bcfd-6d7f5eca9acd None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:22.642788 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac05ad-a0d0-4a8a-bcfd-6d7f5eca9acd None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:22.643293 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac05ad-a0d0-4a8a-bcfd-6d7f5eca9acd None admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:22.644252 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac05ad-a0d0-4a8a-bcfd-6d7f5eca9acd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:22.644760 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac05ad-a0d0-4a8a-bcfd-6d7f5eca9acd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:22.646408 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac05ad-a0d0-4a8a-bcfd-6d7f5eca9acd None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:22.653112 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886a982-bcbb-4df5-b307-6358e605a5bb None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:22.670447 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 330/651] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Aug 17 14:47:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:22.676290 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac05ad-a0d0-4a8a-bcfd-6d7f5eca9acd None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:22.762234 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886a982-bcbb-4df5-b307-6358e605a5bb None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:22.778556 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:22.783221 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac05ad-a0d0-4a8a-bcfd-6d7f5eca9acd None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:22.790719 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:22.800804 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f7675-0b3b-44bf-9a77-c979aa6bcfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:22.801429 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f7675-0b3b-44bf-9a77-c979aa6bcfbc None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:22.801708 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f7675-0b3b-44bf-9a77-c979aa6bcfbc None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:22.802002 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f7675-0b3b-44bf-9a77-c979aa6bcfbc None admin] PATH_INFO: `/v3/services/image` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:22.802581 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f7675-0b3b-44bf-9a77-c979aa6bcfbc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:22.804052 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f7675-0b3b-44bf-9a77-c979aa6bcfbc None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:22.814998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-dd0f7675-0b3b-44bf-9a77-c979aa6bcfbc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 14:47:22.814998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:22.814998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:47:22.814998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:47:22.814998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:47:22.814998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:47:22.814998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:47:22.814998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:22.814998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 14:47:22.814998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:22.814998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:22.814998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:22.814998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:22.814998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:22.814998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:22.814998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:22.814998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:22.816064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:22.816064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:22.816064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:22.816064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:22.816064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:22.816064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:22.816064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:47:22.816064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:47:22.816064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:47:22.816064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:47:22.816064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:22.816064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:22.816064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:22.816064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:22.816064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:22.816064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:22.816901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:22.816901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:22.816901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:22.816901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:22.816901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:22.816901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:22.816901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:22.816901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:22.816901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:22.816901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:22.816901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:47:22.816901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:22.816901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 14:47:22.816901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:22.816901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 322/652] 10.222.0.30 () {56 vars in 1105 bytes} [Wed Aug 17 14:47:22 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:22.817670 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c5202-5226-4add-9600-92ffc80ddfc6 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:22.817670 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c5202-5226-4add-9600-92ffc80ddfc6 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:22.817829 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c5202-5226-4add-9600-92ffc80ddfc6 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:22.819142 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 323/653] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:22.823125 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c5202-5226-4add-9600-92ffc80ddfc6 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:22.833552 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff7d09-4a20-464f-b235-9cac21925984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:22.834191 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff7d09-4a20-464f-b235-9cac21925984 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:22.834465 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff7d09-4a20-464f-b235-9cac21925984 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:22.834732 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff7d09-4a20-464f-b235-9cac21925984 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:22.904075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff7d09-4a20-464f-b235-9cac21925984 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:22.905416 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff7d09-4a20-464f-b235-9cac21925984 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:22.933655 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c5202-5226-4add-9600-92ffc80ddfc6 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:22.967901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b5290-f227-4573-9b3a-ee1bcde0f987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:22.968493 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b5290-f227-4573-9b3a-ee1bcde0f987 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:22.968768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b5290-f227-4573-9b3a-ee1bcde0f987 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:22.969033 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b5290-f227-4573-9b3a-ee1bcde0f987 None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:22.969658 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b5290-f227-4573-9b3a-ee1bcde0f987 None admin] RBAC: Adding query filter params (name=image) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:22.969981 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b5290-f227-4573-9b3a-ee1bcde0f987 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:22.971335 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b5290-f227-4573-9b3a-ee1bcde0f987 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:22.975589 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 324/654] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:47:22.976767 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445f247-00e5-4923-a561-361daa00e037 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:22.977049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445f247-00e5-4923-a561-361daa00e037 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:22.977316 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445f247-00e5-4923-a561-361daa00e037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:22.995205 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-5445f247-00e5-4923-a561-361daa00e037 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:22.996964 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-5445f247-00e5-4923-a561-361daa00e037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:23.002305 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:23.007259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 331/655] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:47:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 14:47:23.008075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff7d09-4a20-464f-b235-9cac21925984 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:23.052287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:23.070932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 325/656] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:47:23.071744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445f247-00e5-4923-a561-361daa00e037 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:23.113446 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff7d09-4a20-464f-b235-9cac21925984 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:23.151585 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bf625-bf0e-475e-8463-77355f8fbe99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:23.152559 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bf625-bf0e-475e-8463-77355f8fbe99 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:23.153034 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bf625-bf0e-475e-8463-77355f8fbe99 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:23.153504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bf625-bf0e-475e-8463-77355f8fbe99 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:23.154364 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bf625-bf0e-475e-8463-77355f8fbe99 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:23.156055 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bf625-bf0e-475e-8463-77355f8fbe99 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:23.167831 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-6d2bf625-bf0e-475e-8463-77355f8fbe99 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 14:47:23.167831 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:23.167831 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:47:23.167831 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:47:23.167831 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:47:23.167831 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:47:23.167831 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:47:23.167831 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:23.167831 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 14:47:23.167831 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:23.167831 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:23.167831 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:23.167831 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:23.167831 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:23.167831 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:23.167831 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:23.167831 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:23.168839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:23.168839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:23.168839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:23.168839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:23.168839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:23.168839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:23.168839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:47:23.168839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:47:23.168839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:47:23.168839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:47:23.168839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:23.168839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:23.168839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:23.168839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:23.168839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:23.168839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:23.169663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:23.169663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:23.169663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:23.169663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:23.169663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:23.169663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:23.169663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:23.169663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:23.169663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:23.169663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:23.169663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:47:23.169663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:23.169663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 14:47:23.169663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:23.169663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 332/657] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Aug 17 14:47:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:23.170503 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bf625-bf0e-475e-8463-77355f8fbe99 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:23.184500 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445f247-00e5-4923-a561-361daa00e037 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:23.219635 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db9f22-e661-4908-9d87-59ef60cc3528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:23.220243 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db9f22-e661-4908-9d87-59ef60cc3528 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:23.220523 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db9f22-e661-4908-9d87-59ef60cc3528 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:23.220797 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db9f22-e661-4908-9d87-59ef60cc3528 None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:23.221437 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db9f22-e661-4908-9d87-59ef60cc3528 None admin] RBAC: Adding query filter params (type=image) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:23.221762 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db9f22-e661-4908-9d87-59ef60cc3528 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:23.223126 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db9f22-e661-4908-9d87-59ef60cc3528 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:23.228762 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 326/658] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:23.229559 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db9f22-e661-4908-9d87-59ef60cc3528 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:23.252144 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:23.301068 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bf625-bf0e-475e-8463-77355f8fbe99 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:23.317935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:23.345600 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f853e-dc1a-4571-8605-b18e48c798a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:23.346799 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f853e-dc1a-4571-8605-b18e48c798a2 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:23.347406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f853e-dc1a-4571-8605-b18e48c798a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:23.347734 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f853e-dc1a-4571-8605-b18e48c798a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:23.360573 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f853e-dc1a-4571-8605-b18e48c798a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:23.362176 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f853e-dc1a-4571-8605-b18e48c798a2 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:23.379415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-8e2f853e-dc1a-4571-8605-b18e48c798a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:23.379415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:23.379415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:23.379415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:23.379415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:23.379415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:23.379415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:23.379415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:23.379415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:23.379415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:23.379415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:23.379415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:23.379415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:23.379415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:23.379415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:23.379415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:23.380425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:23.380425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:23.380425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:23.380425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:23.380425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:23.380425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:23.380425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:23.380425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:23.380425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:23.380425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:23.380425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:23.380425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:23.380425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:23.380425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:23.380425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:23.380425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:23.380425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:23.381341 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:23.381341 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:23.381341 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:23.386089 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 333/659] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:23.387728 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f853e-dc1a-4571-8605-b18e48c798a2 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:23.390320 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db9f22-e661-4908-9d87-59ef60cc3528 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:23.430909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974400b7-d4b7-4ba5-9d02-df6e99f891eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:23.431435 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974400b7-d4b7-4ba5-9d02-df6e99f891eb None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:23.431712 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974400b7-d4b7-4ba5-9d02-df6e99f891eb None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:23.432043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974400b7-d4b7-4ba5-9d02-df6e99f891eb None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:23.432690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974400b7-d4b7-4ba5-9d02-df6e99f891eb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:23.432991 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974400b7-d4b7-4ba5-9d02-df6e99f891eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:23.434396 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974400b7-d4b7-4ba5-9d02-df6e99f891eb None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:23.441436 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 327/660] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Aug 17 14:47:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:23.442568 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974400b7-d4b7-4ba5-9d02-df6e99f891eb None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:23.506761 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f853e-dc1a-4571-8605-b18e48c798a2 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:23.528654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:23.552621 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91849c-898e-45cf-8d49-100227ac08cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:23.553232 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91849c-898e-45cf-8d49-100227ac08cc None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:23.553635 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91849c-898e-45cf-8d49-100227ac08cc None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:23.553804 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91849c-898e-45cf-8d49-100227ac08cc None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:23.554429 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91849c-898e-45cf-8d49-100227ac08cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:23.554726 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91849c-898e-45cf-8d49-100227ac08cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:23.556084 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91849c-898e-45cf-8d49-100227ac08cc None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:23.567456 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974400b7-d4b7-4ba5-9d02-df6e99f891eb None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:23.573044 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 334/661] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:47:23.573044 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91849c-898e-45cf-8d49-100227ac08cc None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:23.586769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:23.612074 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f8a95-6784-42a1-b467-a9a23844ae81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:23.612708 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f8a95-6784-42a1-b467-a9a23844ae81 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:23.612980 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f8a95-6784-42a1-b467-a9a23844ae81 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:23.613247 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f8a95-6784-42a1-b467-a9a23844ae81 None admin] PATH_INFO: `/v3/services/network` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:23.613861 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f8a95-6784-42a1-b467-a9a23844ae81 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:23.615217 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f8a95-6784-42a1-b467-a9a23844ae81 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:23.625923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-3e7f8a95-6784-42a1-b467-a9a23844ae81 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 14:47:23.625923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:23.625923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:47:23.625923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:47:23.625923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:47:23.625923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:47:23.625923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:47:23.625923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:23.625923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 14:47:23.625923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:23.625923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:23.625923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:23.625923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:23.625923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:23.625923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:23.625923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:23.625923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:23.626977 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:23.626977 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:23.626977 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:23.626977 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:23.626977 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:23.626977 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:23.626977 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:47:23.626977 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:47:23.626977 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:47:23.626977 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:47:23.626977 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:23.626977 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:23.626977 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:23.626977 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:23.626977 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:23.626977 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:23.627870 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:23.627870 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:23.627870 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:23.627870 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:23.627870 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:23.627870 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:23.627870 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:23.627870 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:23.627870 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:23.627870 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:23.627870 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:47:23.627870 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:23.627870 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 14:47:23.627870 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:23.627870 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 328/662] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:23 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:23.628675 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f8a95-6784-42a1-b467-a9a23844ae81 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:23.688551 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91849c-898e-45cf-8d49-100227ac08cc None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:23.724990 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4dce7-2f77-4fb8-9ba1-fec9dc78340d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:23.725594 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4dce7-2f77-4fb8-9ba1-fec9dc78340d None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:23.725907 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4dce7-2f77-4fb8-9ba1-fec9dc78340d None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:23.726183 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4dce7-2f77-4fb8-9ba1-fec9dc78340d None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:23.726807 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4dce7-2f77-4fb8-9ba1-fec9dc78340d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:23.727111 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4dce7-2f77-4fb8-9ba1-fec9dc78340d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:23.728462 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4dce7-2f77-4fb8-9ba1-fec9dc78340d None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:23.733477 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f8a95-6784-42a1-b467-a9a23844ae81 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:23.741783 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 335/663] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Aug 17 14:47:23 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:23.741783 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4dce7-2f77-4fb8-9ba1-fec9dc78340d None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:23.786687 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e037c9-3003-421b-9dea-aa0b1a94dc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:23.787323 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e037c9-3003-421b-9dea-aa0b1a94dc26 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:23.787599 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e037c9-3003-421b-9dea-aa0b1a94dc26 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:23.787866 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e037c9-3003-421b-9dea-aa0b1a94dc26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:23.789982 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:23.798009 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e037c9-3003-421b-9dea-aa0b1a94dc26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:23.799934 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e037c9-3003-421b-9dea-aa0b1a94dc26 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:23.814325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-53e037c9-3003-421b-9dea-aa0b1a94dc26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:23.814325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:23.814325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:23.814325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:23.814325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:23.814325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:23.814325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:23.814325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:23.814325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:23.814325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:23.814325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:23.814325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:23.814325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:47:23.814325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:47:23.814325 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:47:23.815288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:47:23.815288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:23.815288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:23.815288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:23.815288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:23.815288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:23.815288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:23.815288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:23.815288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:23.815288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:23.815288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:23.815288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:23.815288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:23.815288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:23.815288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:23.815288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:23.815288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:23.816167 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:47:23.816167 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:47:23.816167 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:47:23.816167 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:47:23.816167 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:47:23.816167 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:47:23.816167 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:23.816167 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:23.823620 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 329/664] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:23.824962 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e037c9-3003-421b-9dea-aa0b1a94dc26 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:23.863427 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4dce7-2f77-4fb8-9ba1-fec9dc78340d None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:23.866328 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:23.902862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba80f0f-6656-4de7-bfdc-119464b49b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:23.903579 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba80f0f-6656-4de7-bfdc-119464b49b23 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:23.903854 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba80f0f-6656-4de7-bfdc-119464b49b23 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:23.904120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba80f0f-6656-4de7-bfdc-119464b49b23 None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:23.904815 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba80f0f-6656-4de7-bfdc-119464b49b23 None admin] RBAC: Adding query filter params (name=network) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:23.905117 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba80f0f-6656-4de7-bfdc-119464b49b23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:23.906535 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba80f0f-6656-4de7-bfdc-119464b49b23 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:23.916928 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 336/665] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 17 14:47:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:23.918702 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba80f0f-6656-4de7-bfdc-119464b49b23 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:23.950847 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e037c9-3003-421b-9dea-aa0b1a94dc26 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:23.992758 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a010ca-b4b6-47e5-b840-5561064829db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:23.993918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a010ca-b4b6-47e5-b840-5561064829db None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:23.994877 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a010ca-b4b6-47e5-b840-5561064829db None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:23.995743 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a010ca-b4b6-47e5-b840-5561064829db None admin] PATH_INFO: `/v3/projects` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:23.997030 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a010ca-b4b6-47e5-b840-5561064829db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:23.997612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a010ca-b4b6-47e5-b840-5561064829db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:23.999185 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a010ca-b4b6-47e5-b840-5561064829db None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:24.019810 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 330/666] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:47:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:24.031011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a010ca-b4b6-47e5-b840-5561064829db None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:24.061202 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba80f0f-6656-4de7-bfdc-119464b49b23 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:24.063465 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:24.109547 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca0f08-c5a1-4e5a-90ed-7eceb034cfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:24.110331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca0f08-c5a1-4e5a-90ed-7eceb034cfa2 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:24.110723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca0f08-c5a1-4e5a-90ed-7eceb034cfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:24.111161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca0f08-c5a1-4e5a-90ed-7eceb034cfa2 None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:24.111887 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca0f08-c5a1-4e5a-90ed-7eceb034cfa2 None admin] RBAC: Adding query filter params (type=network) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:24.112287 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca0f08-c5a1-4e5a-90ed-7eceb034cfa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:24.114287 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca0f08-c5a1-4e5a-90ed-7eceb034cfa2 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:24.121768 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 337/667] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 17 14:47:23 2022] GET /identity/v3/services?type=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:24.147664 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:24.158358 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a010ca-b4b6-47e5-b840-5561064829db None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:24.200477 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248106b-2388-40a1-8ee3-dfa8ec953c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:24.201536 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248106b-2388-40a1-8ee3-dfa8ec953c8f None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:24.202056 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248106b-2388-40a1-8ee3-dfa8ec953c8f None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:24.202544 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248106b-2388-40a1-8ee3-dfa8ec953c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:24.203486 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248106b-2388-40a1-8ee3-dfa8ec953c8f None admin] RBAC: Adding query filter params (role.id=a307f157f2a445c7af8bd4fd41aa1c4b, scope.project.id=e9d40280440c4d25b6d60a431d6f788b, user.id=8aca6a001d3b479bab684772768d49f5) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:24.204063 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248106b-2388-40a1-8ee3-dfa8ec953c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:24.205800 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248106b-2388-40a1-8ee3-dfa8ec953c8f None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:24.212852 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 331/668] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:47:24 2022] GET /identity/v3/role_assignments?user.id=8aca6a001d3b479bab684772768d49f5&scope.project.id=e9d40280440c4d25b6d60a431d6f788b&role.id=a307f157f2a445c7af8bd4fd41aa1c4b => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:25.529442 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ec1f5-3947-4bbc-8130-3d50ae7a6534 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:25.529986 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ec1f5-3947-4bbc-8130-3d50ae7a6534 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:25.530064 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ec1f5-3947-4bbc-8130-3d50ae7a6534 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:25.531698 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 338/669] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:25.537384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4bb32-8912-4c57-97e8-487256430945 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:25.537798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4bb32-8912-4c57-97e8-487256430945 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:25.538018 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4bb32-8912-4c57-97e8-487256430945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:25.565983 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-b3b4bb32-8912-4c57-97e8-487256430945 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:25.567201 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-b3b4bb32-8912-4c57-97e8-487256430945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:25.639002 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 332/670] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:47:25.971406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ec1f5-3947-4bbc-8130-3d50ae7a6534 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:25.998946 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ec3d0-df36-4a00-bc6a-bdbc74a8e9bd None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:25.999401 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ec3d0-df36-4a00-bc6a-bdbc74a8e9bd None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:25.999507 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ec3d0-df36-4a00-bc6a-bdbc74a8e9bd None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:26.001064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 333/671] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:47:26.005879 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eebd22-5729-4240-9145-b7bd64cc2fe9 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:26.006150 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eebd22-5729-4240-9145-b7bd64cc2fe9 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:26.006421 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eebd22-5729-4240-9145-b7bd64cc2fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:26.025476 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-00eebd22-5729-4240-9145-b7bd64cc2fe9 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:26.026764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-00eebd22-5729-4240-9145-b7bd64cc2fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:26.101186 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ec1f5-3947-4bbc-8130-3d50ae7a6534 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:26.117823 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 334/672] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:47:26.144108 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283bf7e-7a4d-4b15-a51b-c4d94eee824d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:26.144706 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283bf7e-7a4d-4b15-a51b-c4d94eee824d None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:26.144978 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283bf7e-7a4d-4b15-a51b-c4d94eee824d None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:26.145247 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283bf7e-7a4d-4b15-a51b-c4d94eee824d None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:26.145920 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283bf7e-7a4d-4b15-a51b-c4d94eee824d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:26.147258 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283bf7e-7a4d-4b15-a51b-c4d94eee824d None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:26.165575 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 339/673] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 17 14:47:25 2022] POST /identity/v3/services => generated 242 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:47:26.419252 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5f982-26c8-473a-8350-819314bf4619 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:26.419437 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5f982-26c8-473a-8350-819314bf4619 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:26.419717 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5f982-26c8-473a-8350-819314bf4619 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:26.421302 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 335/674] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:26.426754 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057ad06-3c38-427e-b0f2-e8ed9e7d502f None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:26.427291 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057ad06-3c38-427e-b0f2-e8ed9e7d502f None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:26.427761 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057ad06-3c38-427e-b0f2-e8ed9e7d502f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:26.447984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-e057ad06-3c38-427e-b0f2-e8ed9e7d502f None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:26.449509 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-e057ad06-3c38-427e-b0f2-e8ed9e7d502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:26.464066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5f982-26c8-473a-8350-819314bf4619 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:26.473197 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:26.488279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:26.548501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 340/675] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:26 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:47:26.548501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10772c1-028f-4c38-aed9-ab98da951f3c None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:26.548501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10772c1-028f-4c38-aed9-ab98da951f3c None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:26.548501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10772c1-028f-4c38-aed9-ab98da951f3c None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:26.548501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 341/676] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:26.555006 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65e85e-0b07-42eb-af74-c55c771a86d1 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:26.555675 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65e85e-0b07-42eb-af74-c55c771a86d1 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:26.559347 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65e85e-0b07-42eb-af74-c55c771a86d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:26.579415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-bd65e85e-0b07-42eb-af74-c55c771a86d1 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:26.581139 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-bd65e85e-0b07-42eb-af74-c55c771a86d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:26.592335 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5f982-26c8-473a-8350-819314bf4619 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:26.633908 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387363b-d994-4545-bd26-24555228ebaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:26.634768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387363b-d994-4545-bd26-24555228ebaa None admin] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:26.636083 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387363b-d994-4545-bd26-24555228ebaa None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:26.636499 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387363b-d994-4545-bd26-24555228ebaa None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:26.637787 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387363b-d994-4545-bd26-24555228ebaa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:26.639841 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387363b-d994-4545-bd26-24555228ebaa None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:26.661696 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 336/677] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 17 14:47:26 2022] POST /identity/v3/services => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:47:26.667385 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 342/678] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:26 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:47:26.909254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65e85e-0b07-42eb-af74-c55c771a86d1 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:26.996050 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:27.016542 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65e85e-0b07-42eb-af74-c55c771a86d1 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:27.030885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387363b-d994-4545-bd26-24555228ebaa None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:27.071504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b3eb4-f9f4-4911-a4cc-41b73b4ee9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:27.073522 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b3eb4-f9f4-4911-a4cc-41b73b4ee9fa None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:27.074376 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b3eb4-f9f4-4911-a4cc-41b73b4ee9fa None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:27.074854 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b3eb4-f9f4-4911-a4cc-41b73b4ee9fa None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:27.075968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b3eb4-f9f4-4911-a4cc-41b73b4ee9fa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:27.078211 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b3eb4-f9f4-4911-a4cc-41b73b4ee9fa None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:27.101666 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 343/679] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 17 14:47:26 2022] POST /identity/v3/services => generated 240 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:47:27.147722 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:27.175765 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387363b-d994-4545-bd26-24555228ebaa None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:27.223550 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579cab4-20b9-49c1-b563-64f0a3fa114c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:27.224498 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579cab4-20b9-49c1-b563-64f0a3fa114c None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:27.224983 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579cab4-20b9-49c1-b563-64f0a3fa114c None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:27.225444 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579cab4-20b9-49c1-b563-64f0a3fa114c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:27.238872 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579cab4-20b9-49c1-b563-64f0a3fa114c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:47:27.244751 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-9579cab4-20b9-49c1-b563-64f0a3fa114c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:47:27.244751 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:27.244751 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:27.244751 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:27.244751 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:27.244751 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:27.244751 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:27.244751 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:27.244751 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:27.244751 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:27.244751 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:27.244751 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:27.244751 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:47:27.244751 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:47:27.244751 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:47:27.244751 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:47:27.246079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:47:27.246079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:47:27.246079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:47:27.246079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:47:27.246079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:27.246079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:27.246079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:27.246079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:27.246079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:27.246079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:27.246079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:27.246079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:27.246079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:27.246079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:27.246079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:27.246079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:27.246918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:27.246918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:27.246918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:27.246918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:27.246918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:47:27.246918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:47:27.246918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:47:27.246918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:47:27.246918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:47:27.246918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:47:27.246918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:47:27.246918 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:27.249315 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 337/680] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 17 14:47:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:27.255440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b3eb4-f9f4-4911-a4cc-41b73b4ee9fa None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:27.373318 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b3eb4-f9f4-4911-a4cc-41b73b4ee9fa None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:27.412923 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fa296-a320-416f-a4e5-ef029355cc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:27.413802 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fa296-a320-416f-a4e5-ef029355cc67 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:27.414257 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fa296-a320-416f-a4e5-ef029355cc67 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:27.414673 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fa296-a320-416f-a4e5-ef029355cc67 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:27.415643 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fa296-a320-416f-a4e5-ef029355cc67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:27.416128 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fa296-a320-416f-a4e5-ef029355cc67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:27.417633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fa296-a320-416f-a4e5-ef029355cc67 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:27.423265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:27.428456 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 344/681] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:47:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:27.434354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579cab4-20b9-49c1-b563-64f0a3fa114c None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:27.543812 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579cab4-20b9-49c1-b563-64f0a3fa114c None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:27.582636 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc5d44-4098-488c-b922-8a21a5d22ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:27.583564 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc5d44-4098-488c-b922-8a21a5d22ab5 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:27.583875 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc5d44-4098-488c-b922-8a21a5d22ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:27.584145 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc5d44-4098-488c-b922-8a21a5d22ab5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:27.587392 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:27.598364 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc5d44-4098-488c-b922-8a21a5d22ab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:27.599820 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc5d44-4098-488c-b922-8a21a5d22ab5 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:27.615109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-46bc5d44-4098-488c-b922-8a21a5d22ab5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:27.615109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:27.615109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:27.615109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:27.615109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:27.615109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:27.615109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:27.615109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:27.615109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:27.615109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:27.615109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:27.615109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:27.615109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:27.615109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:27.615109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:27.615109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:27.616059 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:27.616059 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:27.616059 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:27.616059 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:27.616059 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:27.616059 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:27.616059 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:27.616059 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:27.616059 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:27.616059 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:27.616059 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:27.616059 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:27.616059 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:27.616059 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:27.616059 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:27.616059 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:27.616059 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:27.617332 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:27.617332 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:27.617332 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:27.617332 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 338/682] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:27.623156 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fa296-a320-416f-a4e5-ef029355cc67 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:27.728506 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fa296-a320-416f-a4e5-ef029355cc67 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:27.765818 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a7692-057e-4754-98a0-f07820f43871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:27.766719 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a7692-057e-4754-98a0-f07820f43871 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:27.767171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a7692-057e-4754-98a0-f07820f43871 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:27.767648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a7692-057e-4754-98a0-f07820f43871 None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:27.768479 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a7692-057e-4754-98a0-f07820f43871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:27.768951 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a7692-057e-4754-98a0-f07820f43871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:27.770498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a7692-057e-4754-98a0-f07820f43871 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:27.783170 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 345/683] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:27.791022 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc5d44-4098-488c-b922-8a21a5d22ab5 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:27.904222 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc5d44-4098-488c-b922-8a21a5d22ab5 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:27.941321 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6516db-8170-46c4-989d-4a12ccee429f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:27.942045 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6516db-8170-46c4-989d-4a12ccee429f None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:27.942324 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6516db-8170-46c4-989d-4a12ccee429f None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:27.942594 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6516db-8170-46c4-989d-4a12ccee429f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:27.950606 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6516db-8170-46c4-989d-4a12ccee429f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:27.952042 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6516db-8170-46c4-989d-4a12ccee429f None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:27.963354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-1a6516db-8170-46c4-989d-4a12ccee429f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:47:27.963354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:27.963354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:27.963354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:27.963354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:27.963354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:27.963354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:27.963354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:27.963354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:27.963354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:27.963354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:27.963354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:27.963354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:47:27.963354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:47:27.963354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:47:27.963354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:47:27.964457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:27.964457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:27.964457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:47:27.964457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:27.964457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:47:27.964457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:27.964457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:27.964457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:27.964457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:27.964457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:27.964457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:27.964457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:27.964457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:27.964457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:27.964457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:27.964457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:27.964457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:27.964457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:27.965990 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:27.965990 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:27.965990 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:47:27.965990 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:47:27.965990 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:47:27.965990 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:47:27.965990 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:47:27.965990 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:47:27.965990 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:47:27.965990 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:27.965990 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 339/684] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Aug 17 14:47:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:27.970378 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a7692-057e-4754-98a0-f07820f43871 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:28.030671 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:28.074852 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a7692-057e-4754-98a0-f07820f43871 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:28.110167 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4e2a6-1e36-4c74-b633-524eebdd0353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:28.111084 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4e2a6-1e36-4c74-b633-524eebdd0353 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:28.111557 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4e2a6-1e36-4c74-b633-524eebdd0353 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:28.112171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4e2a6-1e36-4c74-b633-524eebdd0353 None admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:28.113094 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4e2a6-1e36-4c74-b633-524eebdd0353 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:28.113603 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4e2a6-1e36-4c74-b633-524eebdd0353 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:28.115225 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4e2a6-1e36-4c74-b633-524eebdd0353 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:28.134390 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 346/685] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Aug 17 14:47:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:28.145749 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6516db-8170-46c4-989d-4a12ccee429f None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:28.193042 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:28.251009 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6516db-8170-46c4-989d-4a12ccee429f None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:28.287162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8b497-5f02-4e37-8afb-c03b649f5c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:28.287718 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8b497-5f02-4e37-8afb-c03b649f5c7c None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:28.287972 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8b497-5f02-4e37-8afb-c03b649f5c7c None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:28.288239 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8b497-5f02-4e37-8afb-c03b649f5c7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:28.300397 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8b497-5f02-4e37-8afb-c03b649f5c7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:28.301900 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8b497-5f02-4e37-8afb-c03b649f5c7c None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:28.318162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-62f8b497-5f02-4e37-8afb-c03b649f5c7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:28.318162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:28.318162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:28.318162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:28.318162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:28.318162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:28.318162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:28.318162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:28.318162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:28.318162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:28.318162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:28.318162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:28.318162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:28.318162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:28.318162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:28.318162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:28.319203 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:28.319203 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:28.319203 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:28.319203 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:28.319203 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:28.319203 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:28.319203 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:28.319203 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:28.319203 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:28.319203 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:28.319203 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:28.319203 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:28.319203 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:28.319203 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:28.319203 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:28.319203 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:28.319203 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:28.320268 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:28.320268 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:28.320268 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:28.320268 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 340/686] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:28.325766 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4e2a6-1e36-4c74-b633-524eebdd0353 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:28.443108 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4e2a6-1e36-4c74-b633-524eebdd0353 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:28.462072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:28.481382 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f1c0c-ab34-48e3-8ca0-c1c895484476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:28.482017 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f1c0c-ab34-48e3-8ca0-c1c895484476 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:28.482289 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f1c0c-ab34-48e3-8ca0-c1c895484476 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:28.482554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f1c0c-ab34-48e3-8ca0-c1c895484476 None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:28.483195 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f1c0c-ab34-48e3-8ca0-c1c895484476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:28.483493 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f1c0c-ab34-48e3-8ca0-c1c895484476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:28.484835 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f1c0c-ab34-48e3-8ca0-c1c895484476 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:28.497556 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 347/687] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:28.503038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ab388-752e-42d4-892d-15a6aad99e95 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:28.503168 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f1c0c-ab34-48e3-8ca0-c1c895484476 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:28.503787 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ab388-752e-42d4-892d-15a6aad99e95 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:28.504314 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ab388-752e-42d4-892d-15a6aad99e95 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:28.505968 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 341/688] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:28.511038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01617b44-26ae-40f8-8dc8-4abe09cc734b None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:28.511582 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01617b44-26ae-40f8-8dc8-4abe09cc734b None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:28.512050 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01617b44-26ae-40f8-8dc8-4abe09cc734b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:28.531955 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-01617b44-26ae-40f8-8dc8-4abe09cc734b None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:28.533503 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-01617b44-26ae-40f8-8dc8-4abe09cc734b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:28.613002 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 342/689] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:28 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:47:28.626888 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f1c0c-ab34-48e3-8ca0-c1c895484476 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:28.666026 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd506ca4-98ff-4426-a56a-d1fb29e0e354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:28.666976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd506ca4-98ff-4426-a56a-d1fb29e0e354 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:28.667286 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd506ca4-98ff-4426-a56a-d1fb29e0e354 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:28.667557 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd506ca4-98ff-4426-a56a-d1fb29e0e354 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:28.674302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd506ca4-98ff-4426-a56a-d1fb29e0e354 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:28.675730 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd506ca4-98ff-4426-a56a-d1fb29e0e354 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:28.687209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-bd506ca4-98ff-4426-a56a-d1fb29e0e354 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:28.687209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:28.687209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:28.687209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:28.687209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:28.687209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:28.687209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:28.687209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:28.687209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:28.687209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:28.687209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:28.687209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:28.687209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:47:28.687209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:47:28.687209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:47:28.688120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:47:28.688120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:28.688120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:28.688120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:28.688120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:28.688120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:28.688120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:28.688120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:28.688120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:28.688120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:28.688120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:28.688120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:28.688120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:28.688120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:28.688120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:28.688120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:28.688120 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:28.690285 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:47:28.690285 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:47:28.690285 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:47:28.690285 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:47:28.690285 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:47:28.690285 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:47:28.690285 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:28.690285 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:28.690285 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 348/690] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:47:28.695288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01617b44-26ae-40f8-8dc8-4abe09cc734b None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:28.728665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:28.810955 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01617b44-26ae-40f8-8dc8-4abe09cc734b None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:28.845745 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379376d1-e2d8-4226-928c-d127df55cbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:28.846364 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379376d1-e2d8-4226-928c-d127df55cbc2 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:28.846639 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379376d1-e2d8-4226-928c-d127df55cbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:28.846904 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379376d1-e2d8-4226-928c-d127df55cbc2 None admin] PATH_INFO: `/v3/projects` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:28.847593 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379376d1-e2d8-4226-928c-d127df55cbc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:28.847893 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379376d1-e2d8-4226-928c-d127df55cbc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:28.849304 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379376d1-e2d8-4226-928c-d127df55cbc2 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:28.862308 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 343/691] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:47:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:28.868313 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd506ca4-98ff-4426-a56a-d1fb29e0e354 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:28.910663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:28.930297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adaccc-2b40-4ad8-99ee-2dd4c1f75a76 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:28.930608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adaccc-2b40-4ad8-99ee-2dd4c1f75a76 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:28.930941 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adaccc-2b40-4ad8-99ee-2dd4c1f75a76 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:28.933119 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 344/692] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:47:28.938013 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a96c1-3411-43bf-825e-88c1b35d5e7a None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:28.938405 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a96c1-3411-43bf-825e-88c1b35d5e7a None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:28.938677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a96c1-3411-43bf-825e-88c1b35d5e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:28.958217 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-5b8a96c1-3411-43bf-825e-88c1b35d5e7a None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:28.959453 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-5b8a96c1-3411-43bf-825e-88c1b35d5e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:28.974892 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd506ca4-98ff-4426-a56a-d1fb29e0e354 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:29.013750 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df6aab-f4f9-4652-86d5-232420c3220c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:29.014715 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df6aab-f4f9-4652-86d5-232420c3220c None admin] REQUEST_METHOD: `PUT` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:29.014992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df6aab-f4f9-4652-86d5-232420c3220c None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:29.015261 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df6aab-f4f9-4652-86d5-232420c3220c None admin] PATH_INFO: `/v3/projects/e9d40280440c4d25b6d60a431d6f788b/users/8aca6a001d3b479bab684772768d49f5/roles/a307f157f2a445c7af8bd4fd41aa1c4b` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:29.017617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df6aab-f4f9-4652-86d5-232420c3220c None admin] RBAC: Authorizing `identity:create_grant(project_id=e9d40280440c4d25b6d60a431d6f788b, user_id=8aca6a001d3b479bab684772768d49f5, role_id=a307f157f2a445c7af8bd4fd41aa1c4b)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:29.019085 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df6aab-f4f9-4652-86d5-232420c3220c None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:29.033291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 345/693] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:28 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:47:29.041057 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 349/694] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 17 14:47:28 2022] PUT /identity/v3/projects/e9d40280440c4d25b6d60a431d6f788b/users/8aca6a001d3b479bab684772768d49f5/roles/a307f157f2a445c7af8bd4fd41aa1c4b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:47:29.041816 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a96c1-3411-43bf-825e-88c1b35d5e7a None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:29.073251 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:29.162595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a96c1-3411-43bf-825e-88c1b35d5e7a None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:29.202887 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493bde0-6cfe-4b73-abde-c5479afd4ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:29.203537 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493bde0-6cfe-4b73-abde-c5479afd4ed7 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:29.203815 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493bde0-6cfe-4b73-abde-c5479afd4ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:29.204088 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493bde0-6cfe-4b73-abde-c5479afd4ed7 None admin] PATH_INFO: `/v3/services/image` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:29.204684 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493bde0-6cfe-4b73-abde-c5479afd4ed7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:29.206164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493bde0-6cfe-4b73-abde-c5479afd4ed7 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:29.216672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-9493bde0-6cfe-4b73-abde-c5479afd4ed7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 14:47:29.216672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:29.216672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:47:29.216672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:47:29.216672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:47:29.216672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:47:29.216672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:47:29.216672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:29.216672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 14:47:29.216672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:29.216672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:29.216672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:29.216672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:29.216672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:29.216672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:29.216672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:29.216672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:29.217768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:29.217768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:29.217768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:29.217768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:29.217768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:29.217768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:29.217768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:47:29.217768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:47:29.217768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:47:29.217768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:47:29.217768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:29.217768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:29.217768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:29.217768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:29.217768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:29.217768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:29.218626 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:29.218626 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:29.218626 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:29.218626 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:29.218626 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:29.218626 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:29.218626 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:29.218626 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:29.218626 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:29.218626 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:29.218626 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:47:29.218626 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:29.218626 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 14:47:29.218626 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:29.218626 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 346/695] 10.222.0.30 () {56 vars in 1105 bytes} [Wed Aug 17 14:47:29 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:29.227373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df6aab-f4f9-4652-86d5-232420c3220c None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:29.335814 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:29.345720 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df6aab-f4f9-4652-86d5-232420c3220c None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:29.384254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e61b3-da04-4199-8eda-5a9f3cc84f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:29.385869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e61b3-da04-4199-8eda-5a9f3cc84f34 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:29.386354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e61b3-da04-4199-8eda-5a9f3cc84f34 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:29.386822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e61b3-da04-4199-8eda-5a9f3cc84f34 None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:29.387679 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e61b3-da04-4199-8eda-5a9f3cc84f34 None admin] RBAC: Adding query filter params (name=image) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:29.388335 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e61b3-da04-4199-8eda-5a9f3cc84f34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:29.390866 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493bde0-6cfe-4b73-abde-c5479afd4ed7 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:29.391985 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e61b3-da04-4199-8eda-5a9f3cc84f34 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:29.398596 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 350/696] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:29.406690 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e61b3-da04-4199-8eda-5a9f3cc84f34 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:29.499789 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:29.521967 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493bde0-6cfe-4b73-abde-c5479afd4ed7 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:29.535330 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e61b3-da04-4199-8eda-5a9f3cc84f34 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:29.579615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f12eee-f36f-40cc-8820-e9015a5a7467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:29.580418 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f12eee-f36f-40cc-8820-e9015a5a7467 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:29.580788 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f12eee-f36f-40cc-8820-e9015a5a7467 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:29.581247 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f12eee-f36f-40cc-8820-e9015a5a7467 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:29.582070 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f12eee-f36f-40cc-8820-e9015a5a7467 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:29.583056 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857f926-e792-4139-9c74-ab2ebbeb7137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:29.583648 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f12eee-f36f-40cc-8820-e9015a5a7467 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:29.583967 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857f926-e792-4139-9c74-ab2ebbeb7137 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:29.584380 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857f926-e792-4139-9c74-ab2ebbeb7137 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:29.584823 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857f926-e792-4139-9c74-ab2ebbeb7137 None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:29.585630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857f926-e792-4139-9c74-ab2ebbeb7137 None admin] RBAC: Adding query filter params (type=image) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:29.586174 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857f926-e792-4139-9c74-ab2ebbeb7137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:29.587770 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857f926-e792-4139-9c74-ab2ebbeb7137 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:29.594612 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 351/697] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:29.595011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-51f12eee-f36f-40cc-8820-e9015a5a7467 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 14:47:29.595011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:29.595011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:47:29.595011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:47:29.595011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:47:29.595011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:47:29.595011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:47:29.595011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:29.595011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 14:47:29.595011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:29.595011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:29.595011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:29.595011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:29.595011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:29.595011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:29.595011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:29.595011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:29.600149 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:29.600149 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:29.600149 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:29.600149 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:29.600149 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:29.600149 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:29.600149 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:47:29.600149 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:47:29.600149 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:47:29.600149 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:47:29.600149 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:29.600149 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:29.600149 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:29.600149 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:29.600149 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:29.600149 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:29.601269 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:29.601269 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:29.601269 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:29.601269 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:29.601269 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:29.601269 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:29.601269 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:29.601269 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:29.601269 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:29.601269 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:29.601269 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:47:29.601269 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:29.601269 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 14:47:29.601269 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:29.601269 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 347/698] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Aug 17 14:47:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:47:29.602702 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347df96-bd5b-420d-9909-90430dc29b07 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:29.602702 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347df96-bd5b-420d-9909-90430dc29b07 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:29.602702 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347df96-bd5b-420d-9909-90430dc29b07 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:29.602702 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 352/699] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:29.602971 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f12eee-f36f-40cc-8820-e9015a5a7467 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:29.604945 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347df96-bd5b-420d-9909-90430dc29b07 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:29.636513 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:29.717753 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347df96-bd5b-420d-9909-90430dc29b07 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:29.721118 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f12eee-f36f-40cc-8820-e9015a5a7467 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:29.755008 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03169108-b8bf-44dc-b411-89d4c5d4ebae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:29.755612 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03169108-b8bf-44dc-b411-89d4c5d4ebae None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:29.755888 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03169108-b8bf-44dc-b411-89d4c5d4ebae None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:29.756157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03169108-b8bf-44dc-b411-89d4c5d4ebae None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:29.756788 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03169108-b8bf-44dc-b411-89d4c5d4ebae None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:29.757090 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03169108-b8bf-44dc-b411-89d4c5d4ebae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:29.757950 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d60fea-6ee3-48df-b835-70160f4f1b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:29.758484 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03169108-b8bf-44dc-b411-89d4c5d4ebae None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:29.758595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d60fea-6ee3-48df-b835-70160f4f1b5a None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:29.758825 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d60fea-6ee3-48df-b835-70160f4f1b5a None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:29.759095 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d60fea-6ee3-48df-b835-70160f4f1b5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:29.759842 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d60fea-6ee3-48df-b835-70160f4f1b5a None admin] RBAC: Adding query filter params (interface=public, service_id=126f08e72f1e43f9883f4243c95a0928, region_id=RegionOne) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:29.760328 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d60fea-6ee3-48df-b835-70160f4f1b5a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:29.761684 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d60fea-6ee3-48df-b835-70160f4f1b5a None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:29.763590 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 353/700] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Aug 17 14:47:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:29.764902 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d990a2b-6227-455a-879c-cb6cd54385f8 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:29.765353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d990a2b-6227-455a-879c-cb6cd54385f8 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:29.765821 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d990a2b-6227-455a-879c-cb6cd54385f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:29.776859 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 348/701] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Aug 17 14:47:29 2022] GET /identity/v3/endpoints?service_id=126f08e72f1e43f9883f4243c95a0928&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:29.776859 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d60fea-6ee3-48df-b835-70160f4f1b5a None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:29.788789 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-9d990a2b-6227-455a-879c-cb6cd54385f8 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:29.789385 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:29.790020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-9d990a2b-6227-455a-879c-cb6cd54385f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:29.863108 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 354/702] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:29 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:47:29.864304 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d990a2b-6227-455a-879c-cb6cd54385f8 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:29.892708 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d60fea-6ee3-48df-b835-70160f4f1b5a None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:29.893502 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:29.937960 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf017c-2d03-4413-93e4-e80a5997c078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:29.939178 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf017c-2d03-4413-93e4-e80a5997c078 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:29.940053 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf017c-2d03-4413-93e4-e80a5997c078 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:29.940772 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf017c-2d03-4413-93e4-e80a5997c078 None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:29.941589 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf017c-2d03-4413-93e4-e80a5997c078 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:29.942280 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf017c-2d03-4413-93e4-e80a5997c078 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:29.944533 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf017c-2d03-4413-93e4-e80a5997c078 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:29.952252 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 349/703] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Aug 17 14:47:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:29.957626 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf017c-2d03-4413-93e4-e80a5997c078 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:29.987873 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d990a2b-6227-455a-879c-cb6cd54385f8 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:30.027572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9299b-6c69-4998-b592-84e6ec9dbf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:30.028281 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9299b-6c69-4998-b592-84e6ec9dbf0c None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:30.028636 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9299b-6c69-4998-b592-84e6ec9dbf0c None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:30.028974 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9299b-6c69-4998-b592-84e6ec9dbf0c None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:30.029694 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9299b-6c69-4998-b592-84e6ec9dbf0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:30.031266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9299b-6c69-4998-b592-84e6ec9dbf0c None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:30.036878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 355/704] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Aug 17 14:47:29 2022] GET /identity/v3/services => generated 1002 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:47:30.062357 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:30.091406 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf017c-2d03-4413-93e4-e80a5997c078 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:30.132610 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57c289-aaea-4c5f-969f-72befcc72081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:30.133525 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57c289-aaea-4c5f-969f-72befcc72081 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:30.134029 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57c289-aaea-4c5f-969f-72befcc72081 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:30.134510 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57c289-aaea-4c5f-969f-72befcc72081 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:30.136060 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57c289-aaea-4c5f-969f-72befcc72081 None admin] RBAC: Adding query filter params (interface=public, service_id=c05f10b2184f46b4b13ff504a8b93af9, region_id=RegionOne) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:30.136747 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57c289-aaea-4c5f-969f-72befcc72081 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:30.138391 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57c289-aaea-4c5f-969f-72befcc72081 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:30.145300 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 350/705] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Aug 17 14:47:29 2022] GET /identity/v3/endpoints?service_id=c05f10b2184f46b4b13ff504a8b93af9&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:47:30.150767 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9299b-6c69-4998-b592-84e6ec9dbf0c None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:30.214301 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57c289-aaea-4c5f-969f-72befcc72081 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:30.254155 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:30.275244 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9299b-6c69-4998-b592-84e6ec9dbf0c None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:30.323445 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca07c4-f479-4813-8bc6-b0bfbbfdb050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:30.324852 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca07c4-f479-4813-8bc6-b0bfbbfdb050 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:30.325630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca07c4-f479-4813-8bc6-b0bfbbfdb050 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:30.326139 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca07c4-f479-4813-8bc6-b0bfbbfdb050 None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:30.326953 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca07c4-f479-4813-8bc6-b0bfbbfdb050 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:30.327450 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57c289-aaea-4c5f-969f-72befcc72081 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:30.329035 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca07c4-f479-4813-8bc6-b0bfbbfdb050 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:30.338964 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 356/706] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Aug 17 14:47:30 2022] GET /identity/v3/services => generated 1002 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:47:30.370961 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfe032-e621-4bbf-ac69-c65ffdc4a9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:30.371615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfe032-e621-4bbf-ac69-c65ffdc4a9f8 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:30.371894 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfe032-e621-4bbf-ac69-c65ffdc4a9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:30.372165 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfe032-e621-4bbf-ac69-c65ffdc4a9f8 None admin] PATH_INFO: `/v3/services/network` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:30.372766 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfe032-e621-4bbf-ac69-c65ffdc4a9f8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:30.374297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfe032-e621-4bbf-ac69-c65ffdc4a9f8 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:30.386491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-88bfe032-e621-4bbf-ac69-c65ffdc4a9f8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 14:47:30.386491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:30.386491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:47:30.386491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:47:30.386491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:47:30.386491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:47:30.386491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:47:30.386491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:30.386491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 14:47:30.386491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:30.386491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:30.386491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:30.386491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:30.386491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:30.386491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:30.386491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:30.386491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:30.387554 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:30.387554 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:30.387554 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:30.387554 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:30.387554 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:30.387554 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:30.387554 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:47:30.387554 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:47:30.387554 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:47:30.387554 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:47:30.387554 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:30.387554 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:30.387554 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:30.387554 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:30.387554 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:30.387554 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:30.388393 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:30.388393 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:30.388393 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:30.388393 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:30.388393 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:30.388393 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:30.388393 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:30.388393 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:30.388393 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:30.388393 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:30.388393 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:47:30.388393 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:30.388393 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 14:47:30.388393 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:30.388393 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 351/707] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:30 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:30.393542 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca07c4-f479-4813-8bc6-b0bfbbfdb050 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:30.515537 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca07c4-f479-4813-8bc6-b0bfbbfdb050 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:30.678067 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e57650-a83e-4917-a492-76c90ef67514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:30.679342 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e57650-a83e-4917-a492-76c90ef67514 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:30.679771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e57650-a83e-4917-a492-76c90ef67514 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:30.680188 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e57650-a83e-4917-a492-76c90ef67514 None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:30.680984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e57650-a83e-4917-a492-76c90ef67514 None admin] RBAC: Adding query filter params (name=network) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:30.681431 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e57650-a83e-4917-a492-76c90ef67514 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:30.683629 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e57650-a83e-4917-a492-76c90ef67514 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:30.688903 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 357/708] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 17 14:47:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:30.694265 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfe032-e621-4bbf-ac69-c65ffdc4a9f8 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:30.700671 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:30.808786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfe032-e621-4bbf-ac69-c65ffdc4a9f8 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:30.844196 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a3f1e-e93a-4dbc-86f8-402decec4a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:30.844803 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a3f1e-e93a-4dbc-86f8-402decec4a94 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:30.845078 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a3f1e-e93a-4dbc-86f8-402decec4a94 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:30.845347 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a3f1e-e93a-4dbc-86f8-402decec4a94 None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:30.846009 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a3f1e-e93a-4dbc-86f8-402decec4a94 None admin] RBAC: Adding query filter params (type=network) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:30.846309 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a3f1e-e93a-4dbc-86f8-402decec4a94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:30.847668 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a3f1e-e93a-4dbc-86f8-402decec4a94 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:30.853106 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 352/709] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 17 14:47:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:30.858947 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e57650-a83e-4917-a492-76c90ef67514 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:30.878232 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:30.967554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e57650-a83e-4917-a492-76c90ef67514 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:31.003232 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154c29a-199a-4a9b-97ef-e3ca1a63c9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:31.003907 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154c29a-199a-4a9b-97ef-e3ca1a63c9c2 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:31.004176 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154c29a-199a-4a9b-97ef-e3ca1a63c9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:31.004490 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154c29a-199a-4a9b-97ef-e3ca1a63c9c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:31.005205 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154c29a-199a-4a9b-97ef-e3ca1a63c9c2 None admin] RBAC: Adding query filter params (interface=public, service_id=a548186bf95b471a94880adf3a1c7a49, region_id=RegionOne) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:31.005672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154c29a-199a-4a9b-97ef-e3ca1a63c9c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:31.008401 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154c29a-199a-4a9b-97ef-e3ca1a63c9c2 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:31.018539 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 358/710] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Aug 17 14:47:30 2022] GET /identity/v3/endpoints?service_id=a548186bf95b471a94880adf3a1c7a49&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:47:31.027434 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a3f1e-e93a-4dbc-86f8-402decec4a94 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:31.099178 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:31.140549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a3f1e-e93a-4dbc-86f8-402decec4a94 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:31.176493 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433fd6f-7779-422f-8c38-3004d593dd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:31.177333 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433fd6f-7779-422f-8c38-3004d593dd6b None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:31.177782 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433fd6f-7779-422f-8c38-3004d593dd6b None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:31.178227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433fd6f-7779-422f-8c38-3004d593dd6b None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:31.178973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433fd6f-7779-422f-8c38-3004d593dd6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:31.180469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433fd6f-7779-422f-8c38-3004d593dd6b None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:31.186500 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 353/711] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Aug 17 14:47:31 2022] GET /identity/v3/services => generated 1002 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:47:31.450683 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56042072-8b09-416a-b680-33fb8cc47ea5 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:31.450913 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56042072-8b09-416a-b680-33fb8cc47ea5 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:31.451131 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56042072-8b09-416a-b680-33fb8cc47ea5 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:31.455592 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 359/712] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:31.458675 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31def710-3138-473a-8cbb-3c661575d0a6 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:31.458967 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31def710-3138-473a-8cbb-3c661575d0a6 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:31.459240 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31def710-3138-473a-8cbb-3c661575d0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:31.479083 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-31def710-3138-473a-8cbb-3c661575d0a6 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:31.480483 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-31def710-3138-473a-8cbb-3c661575d0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:31.561333 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 354/713] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:31 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:47:31.898240 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56042072-8b09-416a-b680-33fb8cc47ea5 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:31.980034 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:32.005582 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56042072-8b09-416a-b680-33fb8cc47ea5 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:32.043928 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2d660-c854-4ff6-9516-1136fa00b9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:32.043928 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2d660-c854-4ff6-9516-1136fa00b9cd None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:32.043928 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2d660-c854-4ff6-9516-1136fa00b9cd None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:32.043928 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2d660-c854-4ff6-9516-1136fa00b9cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:32.054487 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2d660-c854-4ff6-9516-1136fa00b9cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:47:32.059909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-0db2d660-c854-4ff6-9516-1136fa00b9cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:47:32.059909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:32.059909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:32.059909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:32.059909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:32.059909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:32.059909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:32.059909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:32.059909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:32.059909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:32.059909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:32.059909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:32.059909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:47:32.059909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:47:32.059909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:47:32.059909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:47:32.060841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:47:32.060841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:47:32.060841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:47:32.060841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:47:32.060841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:32.060841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:32.060841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:32.060841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:32.060841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:32.060841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:32.060841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:32.060841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:32.060841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:32.060841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:32.060841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:32.060841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:32.061856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:32.061856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:32.061856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:32.061856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:32.061856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:47:32.061856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:47:32.061856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:47:32.061856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:47:32.061856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:47:32.061856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:47:32.061856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:47:32.061856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:32.061856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 360/714] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 17 14:47:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:32.068958 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31def710-3138-473a-8cbb-3c661575d0a6 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:32.133467 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:32.176297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31def710-3138-473a-8cbb-3c661575d0a6 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:32.211512 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100b13a-ee7b-4154-a2b1-bc69b401e3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:32.212119 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100b13a-ee7b-4154-a2b1-bc69b401e3ad None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:32.212399 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100b13a-ee7b-4154-a2b1-bc69b401e3ad None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:32.212672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100b13a-ee7b-4154-a2b1-bc69b401e3ad None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:32.214023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100b13a-ee7b-4154-a2b1-bc69b401e3ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:32.214322 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100b13a-ee7b-4154-a2b1-bc69b401e3ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:32.215692 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100b13a-ee7b-4154-a2b1-bc69b401e3ad None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:32.224439 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 355/715] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:47:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:32.231133 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2d660-c854-4ff6-9516-1136fa00b9cd None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:32.346167 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2d660-c854-4ff6-9516-1136fa00b9cd None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:32.384619 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446fee0-1c9a-45e8-9729-56b29cd6ca84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:32.385315 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446fee0-1c9a-45e8-9729-56b29cd6ca84 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:32.385798 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446fee0-1c9a-45e8-9729-56b29cd6ca84 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:32.386091 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446fee0-1c9a-45e8-9729-56b29cd6ca84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:32.388940 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:32.397133 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446fee0-1c9a-45e8-9729-56b29cd6ca84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:32.398624 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446fee0-1c9a-45e8-9729-56b29cd6ca84 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:32.413916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-b446fee0-1c9a-45e8-9729-56b29cd6ca84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:32.413916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:32.413916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:32.413916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:32.413916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:32.413916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:32.413916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:32.413916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:32.413916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:32.413916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:32.413916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:32.413916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:32.413916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:32.413916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:32.413916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:32.413916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:32.414880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:32.414880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:32.414880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:32.414880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:32.414880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:32.414880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:32.414880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:32.414880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:32.414880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:32.414880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:32.414880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:32.414880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:32.414880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:32.414880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:32.414880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:32.414880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:32.414880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:32.416627 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:32.416627 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:32.416627 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:32.416627 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 361/716] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:32.423284 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100b13a-ee7b-4154-a2b1-bc69b401e3ad None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:32.481013 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a65db5-3afc-4594-a724-d1afb8a49e51 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:32.481665 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a65db5-3afc-4594-a724-d1afb8a49e51 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:32.482219 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a65db5-3afc-4594-a724-d1afb8a49e51 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:32.484109 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 362/717] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:47:32.489010 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092acdcd-5987-4f4b-82fa-6f8dacbf3346 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:32.489290 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092acdcd-5987-4f4b-82fa-6f8dacbf3346 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:32.489554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092acdcd-5987-4f4b-82fa-6f8dacbf3346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:32.508214 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-092acdcd-5987-4f4b-82fa-6f8dacbf3346 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:32.509499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-092acdcd-5987-4f4b-82fa-6f8dacbf3346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:32.564433 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100b13a-ee7b-4154-a2b1-bc69b401e3ad None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:32.592003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:32.603955 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27b2b3-7a8d-4107-a041-ceae53cb9d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:32.604778 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27b2b3-7a8d-4107-a041-ceae53cb9d1e None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:32.605051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27b2b3-7a8d-4107-a041-ceae53cb9d1e None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:32.605313 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27b2b3-7a8d-4107-a041-ceae53cb9d1e None admin] PATH_INFO: `/v3/domains` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:32.605983 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27b2b3-7a8d-4107-a041-ceae53cb9d1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:32.606280 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27b2b3-7a8d-4107-a041-ceae53cb9d1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:32.607638 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27b2b3-7a8d-4107-a041-ceae53cb9d1e None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:32.608030 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 363/718] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:32 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:47:32.628306 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 356/719] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:32.630777 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092acdcd-5987-4f4b-82fa-6f8dacbf3346 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:32.719824 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a90c-b112-4ad1-b612-60e30312cc48 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:32.720475 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a90c-b112-4ad1-b612-60e30312cc48 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:32.720954 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a90c-b112-4ad1-b612-60e30312cc48 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:32.722792 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 357/720] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:47:32.728023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df0ab5-5b08-4194-9d9a-297771957e61 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:32.729121 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df0ab5-5b08-4194-9d9a-297771957e61 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:32.729633 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df0ab5-5b08-4194-9d9a-297771957e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:32.734265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092acdcd-5987-4f4b-82fa-6f8dacbf3346 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:32.755321 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-25df0ab5-5b08-4194-9d9a-297771957e61 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:32.756910 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-25df0ab5-5b08-4194-9d9a-297771957e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:32.770332 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9a97a-13e2-463c-9ea5-b5773b1b9f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:32.771275 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9a97a-13e2-463c-9ea5-b5773b1b9f11 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:32.771754 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9a97a-13e2-463c-9ea5-b5773b1b9f11 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:32.772221 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9a97a-13e2-463c-9ea5-b5773b1b9f11 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:32.780984 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9a97a-13e2-463c-9ea5-b5773b1b9f11 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:32.782907 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9a97a-13e2-463c-9ea5-b5773b1b9f11 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:32.786031 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:32.797585 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-aac9a97a-13e2-463c-9ea5-b5773b1b9f11 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:47:32.797585 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:32.797585 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:32.797585 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:32.797585 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:32.797585 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:32.797585 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:32.797585 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:32.797585 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:32.797585 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:32.797585 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:32.797585 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:32.797585 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:47:32.797585 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:47:32.797585 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:47:32.797585 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:47:32.798710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:32.798710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:32.798710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:47:32.798710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:32.798710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:47:32.798710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:32.798710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:32.798710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:32.798710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:32.798710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:32.798710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:32.798710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:32.798710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:32.798710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:32.798710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:32.798710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:32.798710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:32.798710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:32.799685 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:32.799685 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:32.799685 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:47:32.799685 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:47:32.799685 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:47:32.799685 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:47:32.799685 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:47:32.799685 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:47:32.799685 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:47:32.799685 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:32.802165 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 364/721] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Aug 17 14:47:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:32.804531 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9a97a-13e2-463c-9ea5-b5773b1b9f11 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:32.851964 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 358/722] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:32 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:47:32.914129 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9a97a-13e2-463c-9ea5-b5773b1b9f11 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:32.938817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df0ab5-5b08-4194-9d9a-297771957e61 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:32.953606 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ab001-280f-4d60-afea-99238c514636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:32.954841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ab001-280f-4d60-afea-99238c514636 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:32.955371 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ab001-280f-4d60-afea-99238c514636 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:32.955837 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ab001-280f-4d60-afea-99238c514636 None admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:32.956751 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ab001-280f-4d60-afea-99238c514636 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:32.957358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ab001-280f-4d60-afea-99238c514636 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:32.959393 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ab001-280f-4d60-afea-99238c514636 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:32.983870 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 365/723] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Aug 17 14:47:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:47:32.992524 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ab001-280f-4d60-afea-99238c514636 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:33.030557 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:33.109590 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ab001-280f-4d60-afea-99238c514636 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:33.154289 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ea78c-e567-4951-8667-5c8130fa8335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:33.154890 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ea78c-e567-4951-8667-5c8130fa8335 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:33.155165 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ea78c-e567-4951-8667-5c8130fa8335 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:33.155427 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ea78c-e567-4951-8667-5c8130fa8335 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:33.184257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df0ab5-5b08-4194-9d9a-297771957e61 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:33.200408 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:33.223045 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83655871-b1d2-42bf-9cbb-0eda0a88a324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:33.223668 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83655871-b1d2-42bf-9cbb-0eda0a88a324 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:33.223942 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83655871-b1d2-42bf-9cbb-0eda0a88a324 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:33.224239 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83655871-b1d2-42bf-9cbb-0eda0a88a324 None admin] PATH_INFO: `/v3/services/image` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:33.224777 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83655871-b1d2-42bf-9cbb-0eda0a88a324 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:33.226155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83655871-b1d2-42bf-9cbb-0eda0a88a324 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:33.236605 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ea78c-e567-4951-8667-5c8130fa8335 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:33.238057 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ea78c-e567-4951-8667-5c8130fa8335 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:33.238574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-83655871-b1d2-42bf-9cbb-0eda0a88a324 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 14:47:33.238574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:33.238574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:47:33.238574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:47:33.238574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:47:33.238574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:47:33.238574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:47:33.238574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:33.238574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 14:47:33.238574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:33.238574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:33.238574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:33.238574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:33.238574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:33.238574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:33.238574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:33.238574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:33.239531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:33.239531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:33.239531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:33.239531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:33.239531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:33.239531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:33.239531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:47:33.239531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:47:33.239531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:47:33.239531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:47:33.239531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:33.239531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:33.239531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:33.239531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:33.239531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:33.239531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:33.240371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:33.240371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:33.240371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:33.240371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:33.240371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:33.240371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:33.240371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:33.240371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:33.240371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:33.240371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:33.240371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:47:33.240371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:33.240371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 14:47:33.240371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:33.240371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 359/724] 10.222.0.30 () {56 vars in 1105 bytes} [Wed Aug 17 14:47:32 2022] GET /identity/v3/services/image => generated 86 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:47:33.241166 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83655871-b1d2-42bf-9cbb-0eda0a88a324 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:33.277017 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:33.355700 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 366/725] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:47:32 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:47:33.356500 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83655871-b1d2-42bf-9cbb-0eda0a88a324 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:33.357198 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ea78c-e567-4951-8667-5c8130fa8335 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:33.399783 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095e545-0373-4157-9b27-14ba6b61ac72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:33.400998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095e545-0373-4157-9b27-14ba6b61ac72 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:33.401282 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095e545-0373-4157-9b27-14ba6b61ac72 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:33.401553 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095e545-0373-4157-9b27-14ba6b61ac72 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:33.402176 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095e545-0373-4157-9b27-14ba6b61ac72 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:33.403547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095e545-0373-4157-9b27-14ba6b61ac72 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:33.412702 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-d095e545-0373-4157-9b27-14ba6b61ac72 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 14:47:33.412702 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:33.412702 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:47:33.412702 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:47:33.412702 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:47:33.412702 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:47:33.412702 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:47:33.412702 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:33.412702 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 14:47:33.412702 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:33.412702 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:33.412702 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:33.412702 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:33.412702 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:33.412702 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:33.412702 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:33.412702 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:33.413706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:33.413706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:33.413706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:33.413706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:33.413706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:33.413706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:33.413706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:47:33.413706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:47:33.413706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:47:33.413706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:47:33.413706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:33.413706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:33.413706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:33.413706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:33.413706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:33.413706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:33.414573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:33.414573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:33.414573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:33.414573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:33.414573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:33.414573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:33.414573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:33.414573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:33.414573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:33.414573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:33.414573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:47:33.414573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:33.414573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 14:47:33.414573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:33.414573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 360/726] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Aug 17 14:47:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:33.415752 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095e545-0373-4157-9b27-14ba6b61ac72 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:33.471702 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:33.475857 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ea78c-e567-4951-8667-5c8130fa8335 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:33.514780 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536b569-fff7-40ee-8df9-1a708f13b09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:33.515390 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536b569-fff7-40ee-8df9-1a708f13b09b None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:33.515666 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536b569-fff7-40ee-8df9-1a708f13b09b None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:33.515937 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536b569-fff7-40ee-8df9-1a708f13b09b None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:33.516565 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536b569-fff7-40ee-8df9-1a708f13b09b None admin] RBAC: Adding query filter params (name=image) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:33.516863 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536b569-fff7-40ee-8df9-1a708f13b09b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:33.518390 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536b569-fff7-40ee-8df9-1a708f13b09b None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:33.520514 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:33.523787 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 367/727] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:33.524829 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536b569-fff7-40ee-8df9-1a708f13b09b None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:33.537804 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095e545-0373-4157-9b27-14ba6b61ac72 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:33.574572 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc7533-b32d-41e3-84f0-59dd3c8a6bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:33.575198 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc7533-b32d-41e3-84f0-59dd3c8a6bc6 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:33.575478 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc7533-b32d-41e3-84f0-59dd3c8a6bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:33.575754 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc7533-b32d-41e3-84f0-59dd3c8a6bc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:33.586464 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc7533-b32d-41e3-84f0-59dd3c8a6bc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:33.588027 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc7533-b32d-41e3-84f0-59dd3c8a6bc6 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:33.601714 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-48bc7533-b32d-41e3-84f0-59dd3c8a6bc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:33.601714 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:33.601714 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:33.601714 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:33.601714 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:33.601714 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:33.601714 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:33.601714 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:33.601714 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:33.601714 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:33.601714 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:33.601714 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:33.601714 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:33.601714 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:33.601714 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:33.601714 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:33.602744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:33.602744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:33.602744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:33.602744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:33.602744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:33.602744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:33.602744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:33.602744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:33.602744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:33.602744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:33.602744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:33.602744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:33.602744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:33.602744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:33.602744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:33.602744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:33.602744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:33.603892 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:33.603892 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:33.603892 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:33.603892 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 361/728] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:33.604131 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd523c3-8034-4317-b685-00d6b50db2a2 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:33.604398 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd523c3-8034-4317-b685-00d6b50db2a2 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:33.604674 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd523c3-8034-4317-b685-00d6b50db2a2 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:33.605909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 362/729] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:33.606603 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd523c3-8034-4317-b685-00d6b50db2a2 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:33.633062 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536b569-fff7-40ee-8df9-1a708f13b09b None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:33.666361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ec34c-81fc-4d1b-9639-d04e8cbf2014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:33.666958 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ec34c-81fc-4d1b-9639-d04e8cbf2014 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:33.667226 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ec34c-81fc-4d1b-9639-d04e8cbf2014 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:33.667488 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ec34c-81fc-4d1b-9639-d04e8cbf2014 None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:33.668105 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ec34c-81fc-4d1b-9639-d04e8cbf2014 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:33.668408 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ec34c-81fc-4d1b-9639-d04e8cbf2014 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:33.669740 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ec34c-81fc-4d1b-9639-d04e8cbf2014 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:33.674199 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 368/730] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Aug 17 14:47:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:33.674949 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ec34c-81fc-4d1b-9639-d04e8cbf2014 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:33.701227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:33.709003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd523c3-8034-4317-b685-00d6b50db2a2 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:33.738189 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:33.744834 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4eb64-4ab6-46bf-b290-a10094e6e6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:33.745687 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4eb64-4ab6-46bf-b290-a10094e6e6f2 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:33.745993 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4eb64-4ab6-46bf-b290-a10094e6e6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:33.746264 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4eb64-4ab6-46bf-b290-a10094e6e6f2 None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:33.746919 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4eb64-4ab6-46bf-b290-a10094e6e6f2 None admin] RBAC: Adding query filter params (type=image) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:33.747218 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4eb64-4ab6-46bf-b290-a10094e6e6f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:33.748631 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4eb64-4ab6-46bf-b290-a10094e6e6f2 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:33.753305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 363/731] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:33.754558 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c8e9d-4e23-4d4c-b5c3-8d09b3505c83 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:33.754839 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c8e9d-4e23-4d4c-b5c3-8d09b3505c83 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:33.755110 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c8e9d-4e23-4d4c-b5c3-8d09b3505c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:33.772261 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-236c8e9d-4e23-4d4c-b5c3-8d09b3505c83 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:33.773423 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-236c8e9d-4e23-4d4c-b5c3-8d09b3505c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:33.776964 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ec34c-81fc-4d1b-9639-d04e8cbf2014 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:33.811357 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4985a3-0329-4dd8-a593-bf15780152de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:33.812178 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4985a3-0329-4dd8-a593-bf15780152de None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:33.812615 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4985a3-0329-4dd8-a593-bf15780152de None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:33.813037 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4985a3-0329-4dd8-a593-bf15780152de None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:33.814094 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4985a3-0329-4dd8-a593-bf15780152de None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:33.814404 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4985a3-0329-4dd8-a593-bf15780152de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:33.815752 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4985a3-0329-4dd8-a593-bf15780152de None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:33.826948 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 369/732] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:33.827733 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4985a3-0329-4dd8-a593-bf15780152de None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:33.844214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 364/733] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:33 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:47:33.845022 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c8e9d-4e23-4d4c-b5c3-8d09b3505c83 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:33.936775 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:33.939730 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4985a3-0329-4dd8-a593-bf15780152de None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:33.950415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c8e9d-4e23-4d4c-b5c3-8d09b3505c83 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:33.965483 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:33.977210 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528c69d-bffb-4a8b-8aeb-1682487d2ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:33.977844 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528c69d-bffb-4a8b-8aeb-1682487d2ba1 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:33.978122 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528c69d-bffb-4a8b-8aeb-1682487d2ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:33.978955 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528c69d-bffb-4a8b-8aeb-1682487d2ba1 None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:33.979707 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528c69d-bffb-4a8b-8aeb-1682487d2ba1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:33.980011 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528c69d-bffb-4a8b-8aeb-1682487d2ba1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:33.981469 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528c69d-bffb-4a8b-8aeb-1682487d2ba1 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:33.986600 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 370/734] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Aug 17 14:47:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:33.987981 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639200e-1cbb-486e-abb3-bb3cea493457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:33.988590 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639200e-1cbb-486e-abb3-bb3cea493457 None admin] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:33.988866 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639200e-1cbb-486e-abb3-bb3cea493457 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:33.989132 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639200e-1cbb-486e-abb3-bb3cea493457 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:33.989799 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639200e-1cbb-486e-abb3-bb3cea493457 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:33.991141 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639200e-1cbb-486e-abb3-bb3cea493457 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:33.992237 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528c69d-bffb-4a8b-8aeb-1682487d2ba1 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:34.015341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 365/735] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 17 14:47:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:47:34.016526 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639200e-1cbb-486e-abb3-bb3cea493457 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:34.153050 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528c69d-bffb-4a8b-8aeb-1682487d2ba1 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:34.155603 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639200e-1cbb-486e-abb3-bb3cea493457 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:34.195344 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7900d4c-3d4c-49a3-b772-a7ea765e6e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:34.196005 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7900d4c-3d4c-49a3-b772-a7ea765e6e58 None admin] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:34.196245 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7900d4c-3d4c-49a3-b772-a7ea765e6e58 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:34.196513 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7900d4c-3d4c-49a3-b772-a7ea765e6e58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:34.197808 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7900d4c-3d4c-49a3-b772-a7ea765e6e58 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:34.199223 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7900d4c-3d4c-49a3-b772-a7ea765e6e58 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:34.200912 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d235e6-98cd-4e2d-8b17-e339fbdc49cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:34.201722 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d235e6-98cd-4e2d-8b17-e339fbdc49cd None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:34.202172 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d235e6-98cd-4e2d-8b17-e339fbdc49cd None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:34.202603 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d235e6-98cd-4e2d-8b17-e339fbdc49cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:34.210211 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:34.210846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d235e6-98cd-4e2d-8b17-e339fbdc49cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:34.212390 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d235e6-98cd-4e2d-8b17-e339fbdc49cd None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:34.224376 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 366/736] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 17 14:47:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:47:34.226606 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7900d4c-3d4c-49a3-b772-a7ea765e6e58 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:34.229857 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-b1d235e6-98cd-4e2d-8b17-e339fbdc49cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:34.229857 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:34.229857 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:34.229857 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:34.229857 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:34.229857 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:34.229857 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:34.229857 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:34.229857 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:34.229857 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:34.229857 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:34.229857 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:34.229857 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:47:34.229857 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:47:34.229857 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:47:34.230992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:47:34.230992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:34.230992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:34.230992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:34.230992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:34.230992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:34.230992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:34.230992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:34.230992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:34.230992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:34.230992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:34.230992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:34.230992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:34.230992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:34.230992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:34.230992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:34.230992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:34.232045 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:47:34.232045 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:47:34.232045 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:47:34.232045 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:47:34.232045 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:47:34.232045 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:47:34.232045 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:34.232045 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:34.232045 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 371/737] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:34.236663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d235e6-98cd-4e2d-8b17-e339fbdc49cd None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:34.310316 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:34.373376 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d235e6-98cd-4e2d-8b17-e339fbdc49cd None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:34.387245 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7900d4c-3d4c-49a3-b772-a7ea765e6e58 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:34.411136 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c32e84-4362-46b5-be9c-4988d68a03d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:34.411669 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c32e84-4362-46b5-be9c-4988d68a03d2 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:34.411948 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c32e84-4362-46b5-be9c-4988d68a03d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:34.412218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c32e84-4362-46b5-be9c-4988d68a03d2 None admin] PATH_INFO: `/v3/projects` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:34.412924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c32e84-4362-46b5-be9c-4988d68a03d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:34.413232 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c32e84-4362-46b5-be9c-4988d68a03d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:34.414708 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c32e84-4362-46b5-be9c-4988d68a03d2 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:34.430682 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 372/738] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:47:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:47:34.435426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cec1e-1020-42b1-9cd2-23e1898fbfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:34.436288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cec1e-1020-42b1-9cd2-23e1898fbfe1 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:34.436397 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cec1e-1020-42b1-9cd2-23e1898fbfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:34.436637 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cec1e-1020-42b1-9cd2-23e1898fbfe1 None admin] PATH_INFO: `/v3/services/network` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:34.437229 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402cec1e-1020-42b1-9cd2-23e1898fbfe1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:34.437859 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c32e84-4362-46b5-be9c-4988d68a03d2 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:34.438798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402cec1e-1020-42b1-9cd2-23e1898fbfe1 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:34.450612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-402cec1e-1020-42b1-9cd2-23e1898fbfe1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 14:47:34.450612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:34.450612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:47:34.450612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:47:34.450612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:47:34.450612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:47:34.450612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:47:34.450612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:34.450612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 14:47:34.450612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:34.450612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:34.450612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:34.450612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:34.450612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:34.450612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:34.450612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:34.450612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:34.451716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:34.451716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:34.451716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:34.451716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:34.451716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:34.451716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:34.451716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:47:34.451716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:47:34.451716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:47:34.451716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:47:34.451716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:34.451716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:34.451716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:34.451716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:34.451716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:34.451716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:34.452566 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:34.452566 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:34.452566 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:34.452566 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:34.452566 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:34.452566 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:34.452566 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:34.452566 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:34.452566 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:34.452566 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:34.452566 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:47:34.452566 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:34.452566 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 14:47:34.452566 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:34.453297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 367/739] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:34 2022] GET /identity/v3/services/network => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:34.459529 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cec1e-1020-42b1-9cd2-23e1898fbfe1 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:34.548180 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:34.562596 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c32e84-4362-46b5-be9c-4988d68a03d2 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:34.573003 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:34.601841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb848c6-05b1-47a5-b826-4ba2eca9c3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:34.602441 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb848c6-05b1-47a5-b826-4ba2eca9c3b7 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:34.602711 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb848c6-05b1-47a5-b826-4ba2eca9c3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:34.602977 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb848c6-05b1-47a5-b826-4ba2eca9c3b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:34.603933 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb848c6-05b1-47a5-b826-4ba2eca9c3b7 None admin] RBAC: Adding query filter params (role.id=a307f157f2a445c7af8bd4fd41aa1c4b, scope.project.id=e9d40280440c4d25b6d60a431d6f788b, user.id=8aca6a001d3b479bab684772768d49f5) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:34.604521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb848c6-05b1-47a5-b826-4ba2eca9c3b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:34.606020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb848c6-05b1-47a5-b826-4ba2eca9c3b7 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:34.612446 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 373/740] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:47:34 2022] GET /identity/v3/role_assignments?user.id=8aca6a001d3b479bab684772768d49f5&scope.project.id=e9d40280440c4d25b6d60a431d6f788b&role.id=a307f157f2a445c7af8bd4fd41aa1c4b => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:34.618102 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cec1e-1020-42b1-9cd2-23e1898fbfe1 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:34.660861 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9be73-7fb8-4f39-b704-ba94b6d2af6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:34.661590 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9be73-7fb8-4f39-b704-ba94b6d2af6d None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:34.661849 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9be73-7fb8-4f39-b704-ba94b6d2af6d None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:34.662147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9be73-7fb8-4f39-b704-ba94b6d2af6d None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:34.662840 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9be73-7fb8-4f39-b704-ba94b6d2af6d None admin] RBAC: Adding query filter params (name=network) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:34.663141 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9be73-7fb8-4f39-b704-ba94b6d2af6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:34.664558 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9be73-7fb8-4f39-b704-ba94b6d2af6d None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:34.671076 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 368/741] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 17 14:47:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:47:34.679174 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb848c6-05b1-47a5-b826-4ba2eca9c3b7 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:34.800871 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb848c6-05b1-47a5-b826-4ba2eca9c3b7 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:34.838079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69cccd-d071-40f6-8141-902083fc634d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:34.839096 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69cccd-d071-40f6-8141-902083fc634d None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:34.839611 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69cccd-d071-40f6-8141-902083fc634d None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:34.839883 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69cccd-d071-40f6-8141-902083fc634d None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:34.840522 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69cccd-d071-40f6-8141-902083fc634d None admin] RBAC: Adding query filter params (type=network) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:34.840825 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69cccd-d071-40f6-8141-902083fc634d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:34.842224 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69cccd-d071-40f6-8141-902083fc634d None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:34.847526 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 374/742] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 17 14:47:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:34.854009 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9be73-7fb8-4f39-b704-ba94b6d2af6d None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:34.963737 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9be73-7fb8-4f39-b704-ba94b6d2af6d None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:34.984190 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:35.000522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1139a6-993c-4f24-88be-b3881a2d4088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:35.001123 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1139a6-993c-4f24-88be-b3881a2d4088 None admin] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:35.001397 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1139a6-993c-4f24-88be-b3881a2d4088 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:35.001661 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1139a6-993c-4f24-88be-b3881a2d4088 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:35.002378 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1139a6-993c-4f24-88be-b3881a2d4088 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:35.003732 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1139a6-993c-4f24-88be-b3881a2d4088 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:35.026654 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 369/743] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 17 14:47:34 2022] POST /identity/v3/endpoints => generated 337 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:47:36.382025 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f69df-4366-4efe-a177-1adaf8668e1d None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:36.382596 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f69df-4366-4efe-a177-1adaf8668e1d None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:36.382596 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f69df-4366-4efe-a177-1adaf8668e1d None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:36.384088 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 375/744] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:36.390185 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c519fa-7304-4040-82a2-bb54297777d2 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:36.390693 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c519fa-7304-4040-82a2-bb54297777d2 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:36.390769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c519fa-7304-4040-82a2-bb54297777d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:36.410087 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-d8c519fa-7304-4040-82a2-bb54297777d2 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:36.411307 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-d8c519fa-7304-4040-82a2-bb54297777d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:36.497165 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 370/745] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:36 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:47:36.560947 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ce5e7-5011-4424-bd84-609e1cd12d7e None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:36.561224 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ce5e7-5011-4424-bd84-609e1cd12d7e None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:36.561493 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ce5e7-5011-4424-bd84-609e1cd12d7e None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:36.562974 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 376/746] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:36.567909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b59db-615e-48fc-9510-29773d0d6f5a None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:36.568195 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b59db-615e-48fc-9510-29773d0d6f5a None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:36.568466 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b59db-615e-48fc-9510-29773d0d6f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:36.587103 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-0a1b59db-615e-48fc-9510-29773d0d6f5a None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:36.588589 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-0a1b59db-615e-48fc-9510-29773d0d6f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:36.656376 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 371/747] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:36 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:47:36.828413 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ce5e7-5011-4424-bd84-609e1cd12d7e None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:36.879145 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:36.954600 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ce5e7-5011-4424-bd84-609e1cd12d7e None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:36.964188 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000db2c-1599-4549-8e49-e14819277ab2 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:36.964578 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000db2c-1599-4549-8e49-e14819277ab2 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:36.964847 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000db2c-1599-4549-8e49-e14819277ab2 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:36.966374 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 372/748] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:47:36.972343 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dabb4e-48fd-4757-82fc-e6eb06a06b92 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:36.972623 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dabb4e-48fd-4757-82fc-e6eb06a06b92 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:36.972890 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dabb4e-48fd-4757-82fc-e6eb06a06b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:36.991451 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d89fc7-4a2f-437a-8b4a-612a74c75c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:36.992051 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d89fc7-4a2f-437a-8b4a-612a74c75c40 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:36.992213 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-53dabb4e-48fd-4757-82fc-e6eb06a06b92 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:36.992313 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d89fc7-4a2f-437a-8b4a-612a74c75c40 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:36.992585 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d89fc7-4a2f-437a-8b4a-612a74c75c40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:36.993386 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-53dabb4e-48fd-4757-82fc-e6eb06a06b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:37.020679 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:37.063224 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d89fc7-4a2f-437a-8b4a-612a74c75c40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:37.064179 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 373/749] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:36 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:47:37.064663 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d89fc7-4a2f-437a-8b4a-612a74c75c40 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:37.064904 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dabb4e-48fd-4757-82fc-e6eb06a06b92 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:37.106849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:37.167095 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dabb4e-48fd-4757-82fc-e6eb06a06b92 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:37.179360 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 377/750] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:47:36 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:47:37.185703 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d89fc7-4a2f-437a-8b4a-612a74c75c40 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:37.202741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e6e94-bd21-4645-9d67-6f934c245362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:37.203365 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e6e94-bd21-4645-9d67-6f934c245362 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:37.203645 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e6e94-bd21-4645-9d67-6f934c245362 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:37.204057 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e6e94-bd21-4645-9d67-6f934c245362 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:37.204493 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e6e94-bd21-4645-9d67-6f934c245362 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:37.205923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e6e94-bd21-4645-9d67-6f934c245362 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:37.215099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-8f7e6e94-bd21-4645-9d67-6f934c245362 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 14:47:37.215099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:37.215099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:47:37.215099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:47:37.215099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:47:37.215099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:47:37.215099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:47:37.215099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:37.215099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 14:47:37.215099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:37.215099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:37.215099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:37.215099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:37.215099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:37.215099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:37.215099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:37.215099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:37.216140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:37.216140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:37.216140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:37.216140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:37.216140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:37.216140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:37.216140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:47:37.216140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:47:37.216140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:47:37.216140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:47:37.216140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:37.216140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:37.216140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:37.216140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:37.216140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:37.216140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:37.217026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:37.217026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:37.217026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:37.217026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:37.217026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:37.217026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:37.217026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:37.217026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:37.217026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:37.217026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:37.217026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:47:37.217026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:37.217026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 14:47:37.217026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:37.217026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 374/751] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:47:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:37.222255 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e6e94-bd21-4645-9d67-6f934c245362 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:37.251965 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:37.297980 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d89fc7-4a2f-437a-8b4a-612a74c75c40 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:37.324872 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e6e94-bd21-4645-9d67-6f934c245362 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:37.334657 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f96470-5658-4e4d-bba1-dbfa862d36c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:37.335558 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f96470-5658-4e4d-bba1-dbfa862d36c3 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:37.336003 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f96470-5658-4e4d-bba1-dbfa862d36c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:37.336424 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f96470-5658-4e4d-bba1-dbfa862d36c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:37.340161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:37.349641 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f96470-5658-4e4d-bba1-dbfa862d36c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:37.351346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f96470-5658-4e4d-bba1-dbfa862d36c3 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:37.359009 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e168b27-09af-4028-8cbc-28c02ce3715c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:37.359618 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e168b27-09af-4028-8cbc-28c02ce3715c None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:37.359892 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e168b27-09af-4028-8cbc-28c02ce3715c None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:37.360165 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e168b27-09af-4028-8cbc-28c02ce3715c None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:37.360797 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e168b27-09af-4028-8cbc-28c02ce3715c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:37.361098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e168b27-09af-4028-8cbc-28c02ce3715c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:37.362491 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e168b27-09af-4028-8cbc-28c02ce3715c None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:37.367182 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 375/752] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:47:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:47:37.368695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-c9f96470-5658-4e4d-bba1-dbfa862d36c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:37.368695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:37.368695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:37.368695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:37.368695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:37.368695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:37.368695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:37.368695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:37.368695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:37.368695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:37.368695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:37.368695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:37.368695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:47:37.368695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:47:37.368695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:47:37.368695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:47:37.370269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:37.370269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:37.370269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:37.370269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:37.370269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:37.370269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:37.370269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:37.370269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:37.370269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:37.370269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:37.370269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:37.370269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:37.370269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:37.370269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:37.370269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:37.370269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:37.370269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:47:37.371411 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:47:37.371411 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:47:37.371411 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:37.373944 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e168b27-09af-4028-8cbc-28c02ce3715c None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:37.375687 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 378/753] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:47:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:47:37.376513 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f96470-5658-4e4d-bba1-dbfa862d36c3 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:37.467364 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:37.476906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f96470-5658-4e4d-bba1-dbfa862d36c3 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:37.477393 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e168b27-09af-4028-8cbc-28c02ce3715c None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:37.510528 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9c38a-7b47-4f9d-9e71-e08bbec0515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:37.511126 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9c38a-7b47-4f9d-9e71-e08bbec0515f None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:37.511406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9c38a-7b47-4f9d-9e71-e08bbec0515f None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:37.511677 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9c38a-7b47-4f9d-9e71-e08bbec0515f None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:37.511944 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca25d70-c928-4455-99ff-39c3aaa90418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:37.512312 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9c38a-7b47-4f9d-9e71-e08bbec0515f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:37.512541 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca25d70-c928-4455-99ff-39c3aaa90418 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:37.512640 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9c38a-7b47-4f9d-9e71-e08bbec0515f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:37.512818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca25d70-c928-4455-99ff-39c3aaa90418 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:37.513087 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca25d70-c928-4455-99ff-39c3aaa90418 None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:37.513713 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca25d70-c928-4455-99ff-39c3aaa90418 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:37.513979 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9c38a-7b47-4f9d-9e71-e08bbec0515f None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:37.514083 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca25d70-c928-4455-99ff-39c3aaa90418 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:37.515394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca25d70-c928-4455-99ff-39c3aaa90418 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:37.519878 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 376/754] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:47:37 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:47:37.520560 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca25d70-c928-4455-99ff-39c3aaa90418 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:37.537779 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 379/755] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:37.657331 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca25d70-c928-4455-99ff-39c3aaa90418 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:37.698718 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8822c0-3932-4a7b-ad21-add084acb1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:37.699368 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8822c0-3932-4a7b-ad21-add084acb1cd None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:37.699643 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8822c0-3932-4a7b-ad21-add084acb1cd None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:37.699907 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8822c0-3932-4a7b-ad21-add084acb1cd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:37.700504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8822c0-3932-4a7b-ad21-add084acb1cd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:37.701930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8822c0-3932-4a7b-ad21-add084acb1cd None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:37.711595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-bf8822c0-3932-4a7b-ad21-add084acb1cd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 14:47:37.711595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:37.711595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:47:37.711595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:47:37.711595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:47:37.711595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:47:37.711595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:47:37.711595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:37.711595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 14:47:37.711595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:37.711595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:37.711595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:37.711595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:37.711595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:37.711595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:37.711595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:37.712651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:37.712651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:37.712651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:37.712651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:37.712651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:37.712651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:37.712651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:37.712651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:47:37.712651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:47:37.712651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:47:37.712651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:47:37.712651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:37.712651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:37.712651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:37.712651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:37.712651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:37.712651 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:37.714501 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:37.714501 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:37.714501 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:37.714501 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:37.714501 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:37.714501 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:37.714501 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:37.714501 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:37.714501 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:37.714501 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:37.714501 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:47:37.714501 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:37.714501 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 14:47:37.714501 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:37.714501 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 377/756] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Aug 17 14:47:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:37.719885 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9c38a-7b47-4f9d-9e71-e08bbec0515f None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:37.779502 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:37.840096 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9c38a-7b47-4f9d-9e71-e08bbec0515f None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:37.880304 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1681d-e1e8-4fc1-98b3-0d94d461bfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:37.880920 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1681d-e1e8-4fc1-98b3-0d94d461bfa2 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:37.881198 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1681d-e1e8-4fc1-98b3-0d94d461bfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:37.881466 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1681d-e1e8-4fc1-98b3-0d94d461bfa2 None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:37.882185 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1681d-e1e8-4fc1-98b3-0d94d461bfa2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:37.882489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1681d-e1e8-4fc1-98b3-0d94d461bfa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:37.883843 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1681d-e1e8-4fc1-98b3-0d94d461bfa2 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:37.889576 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 380/757] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Aug 17 14:47:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:37.895516 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8822c0-3932-4a7b-ad21-add084acb1cd None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:37.916267 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:37.997836 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8822c0-3932-4a7b-ad21-add084acb1cd None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:38.037291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59bdca-9019-4ca3-9c02-53bf50c02458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:38.037934 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59bdca-9019-4ca3-9c02-53bf50c02458 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:38.038212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59bdca-9019-4ca3-9c02-53bf50c02458 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:38.038482 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59bdca-9019-4ca3-9c02-53bf50c02458 None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:38.039124 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59bdca-9019-4ca3-9c02-53bf50c02458 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:38.039423 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59bdca-9019-4ca3-9c02-53bf50c02458 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:38.048522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59bdca-9019-4ca3-9c02-53bf50c02458 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:38.053615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 378/758] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Aug 17 14:47:37 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:47:39.758760 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b64a74-b45b-4a56-b166-6b1862ff62ab None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:39.759305 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b64a74-b45b-4a56-b166-6b1862ff62ab None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:39.759305 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b64a74-b45b-4a56-b166-6b1862ff62ab None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:39.760810 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 381/759] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:39.765703 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b9e59-5f5b-4677-a5ef-9fd97018bac5 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:39.766123 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b9e59-5f5b-4677-a5ef-9fd97018bac5 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:39.766419 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b9e59-5f5b-4677-a5ef-9fd97018bac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:39.785012 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-f50b9e59-5f5b-4677-a5ef-9fd97018bac5 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:39.786265 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-f50b9e59-5f5b-4677-a5ef-9fd97018bac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:39.854304 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 379/760] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:39 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:47:40.182712 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b64a74-b45b-4a56-b166-6b1862ff62ab None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:40.239089 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f4e90-26cf-439f-88cd-5f68ff7396f4 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:40.239371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f4e90-26cf-439f-88cd-5f68ff7396f4 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:40.239649 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f4e90-26cf-439f-88cd-5f68ff7396f4 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:40.241110 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 380/761] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:47:40.246839 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d643f73-ec74-454b-b168-1396ef69753c None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:40.247129 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d643f73-ec74-454b-b168-1396ef69753c None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:40.247399 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d643f73-ec74-454b-b168-1396ef69753c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:40.265437 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-2d643f73-ec74-454b-b168-1396ef69753c None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:40.266660 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-2d643f73-ec74-454b-b168-1396ef69753c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:40.273861 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:40.285855 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b64a74-b45b-4a56-b166-6b1862ff62ab None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:40.299022 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:40.321036 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676251c-3ee3-45eb-8f3f-45b0e0d5fcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:40.321630 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676251c-3ee3-45eb-8f3f-45b0e0d5fcb4 None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:40.322582 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676251c-3ee3-45eb-8f3f-45b0e0d5fcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:40.322853 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676251c-3ee3-45eb-8f3f-45b0e0d5fcb4 None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:40.323495 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676251c-3ee3-45eb-8f3f-45b0e0d5fcb4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:40.324835 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676251c-3ee3-45eb-8f3f-45b0e0d5fcb4 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:40.335802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 381/762] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:40 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:47:40.339311 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 382/763] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 17 14:47:40 2022] POST /identity/v3/services => generated 251 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:47:40.664513 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d643f73-ec74-454b-b168-1396ef69753c None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:40.769104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d643f73-ec74-454b-b168-1396ef69753c None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:40.809634 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca92014-3ac0-4365-bd0d-7c0418a0c3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:40.810193 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca92014-3ac0-4365-bd0d-7c0418a0c3e4 None admin] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:40.810470 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca92014-3ac0-4365-bd0d-7c0418a0c3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:40.810742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca92014-3ac0-4365-bd0d-7c0418a0c3e4 None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:40.811403 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca92014-3ac0-4365-bd0d-7c0418a0c3e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:40.812760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca92014-3ac0-4365-bd0d-7c0418a0c3e4 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:40.822342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:40.829255 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 382/764] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 17 14:47:40 2022] POST /identity/v3/services => generated 269 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:47:42.550990 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f4c0c-1024-4b47-a7c6-96c89ae8ee98 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:42.551531 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f4c0c-1024-4b47-a7c6-96c89ae8ee98 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:42.551531 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f4c0c-1024-4b47-a7c6-96c89ae8ee98 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:42.553774 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 383/765] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:42.559166 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ada87-9764-4fd3-857a-cea6908266b8 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:42.559576 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ada87-9764-4fd3-857a-cea6908266b8 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:42.559722 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ada87-9764-4fd3-857a-cea6908266b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:42.578400 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-043ada87-9764-4fd3-857a-cea6908266b8 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:42.579586 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-043ada87-9764-4fd3-857a-cea6908266b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:42.651377 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 383/766] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:42 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:47:42.992223 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f4c0c-1024-4b47-a7c6-96c89ae8ee98 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:43.020666 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad380a-1b9f-4c88-86b2-8e7755f7e4cb None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:43.020952 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad380a-1b9f-4c88-86b2-8e7755f7e4cb None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:43.021225 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad380a-1b9f-4c88-86b2-8e7755f7e4cb None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:43.022581 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 384/767] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:47:43.027369 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc26ef1-6495-4624-a64a-72aa42cbfdcd None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:43.027652 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc26ef1-6495-4624-a64a-72aa42cbfdcd None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:43.027925 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc26ef1-6495-4624-a64a-72aa42cbfdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:43.048035 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-dfc26ef1-6495-4624-a64a-72aa42cbfdcd None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:43.049238 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-dfc26ef1-6495-4624-a64a-72aa42cbfdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:43.099669 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f4c0c-1024-4b47-a7c6-96c89ae8ee98 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:43.120176 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 385/768] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:43 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:47:43.133187 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8715755-4ec4-4df5-8578-558aa94ee250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:43.133832 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8715755-4ec4-4df5-8578-558aa94ee250 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:43.134114 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8715755-4ec4-4df5-8578-558aa94ee250 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:43.134452 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8715755-4ec4-4df5-8578-558aa94ee250 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:43.135032 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8715755-4ec4-4df5-8578-558aa94ee250 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:43.136385 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8715755-4ec4-4df5-8578-558aa94ee250 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:43.144824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-f8715755-4ec4-4df5-8578-558aa94ee250 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 14:47:43.144824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:43.144824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:47:43.144824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:47:43.144824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:47:43.144824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:47:43.144824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:47:43.144824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:43.144824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 14:47:43.144824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:43.144824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:43.144824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:43.144824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:43.144824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:43.144824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:43.144824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:43.144824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:43.145878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:43.145878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:43.145878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:43.145878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:43.145878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:43.145878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:43.145878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:47:43.145878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:47:43.145878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:47:43.145878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:47:43.145878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:43.145878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:43.145878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:43.145878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:43.145878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:43.145878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:43.146718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:43.146718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:43.146718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:43.146718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:43.146718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:43.146718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:43.146718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:43.146718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:43.146718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:43.146718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:43.146718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:47:43.146718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:43.146718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 14:47:43.146718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:43.146718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 384/769] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:47:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:43.152076 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc26ef1-6495-4624-a64a-72aa42cbfdcd None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:43.206156 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:43.250929 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc26ef1-6495-4624-a64a-72aa42cbfdcd None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:43.283719 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941f99e-7bb0-4dc7-ac84-3bc5447a80d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:43.284310 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941f99e-7bb0-4dc7-ac84-3bc5447a80d3 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:43.284584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941f99e-7bb0-4dc7-ac84-3bc5447a80d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:43.284850 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941f99e-7bb0-4dc7-ac84-3bc5447a80d3 None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:43.285471 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941f99e-7bb0-4dc7-ac84-3bc5447a80d3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:43.285795 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941f99e-7bb0-4dc7-ac84-3bc5447a80d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:43.287141 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941f99e-7bb0-4dc7-ac84-3bc5447a80d3 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:43.292553 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 386/770] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:47:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:43.298310 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8715755-4ec4-4df5-8578-558aa94ee250 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:43.334919 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:43.400822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8715755-4ec4-4df5-8578-558aa94ee250 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:43.439182 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0667e-92cf-4897-859c-b6b2c39993f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:43.439775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0667e-92cf-4897-859c-b6b2c39993f6 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:43.440065 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0667e-92cf-4897-859c-b6b2c39993f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:43.440332 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0667e-92cf-4897-859c-b6b2c39993f6 None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:43.440952 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0667e-92cf-4897-859c-b6b2c39993f6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:43.441246 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0667e-92cf-4897-859c-b6b2c39993f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:43.442666 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0667e-92cf-4897-859c-b6b2c39993f6 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:43.447942 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 385/771] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:47:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:43.448668 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941f99e-7bb0-4dc7-ac84-3bc5447a80d3 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:43.454029 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0667e-92cf-4897-859c-b6b2c39993f6 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:43.549832 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941f99e-7bb0-4dc7-ac84-3bc5447a80d3 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:43.552129 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0667e-92cf-4897-859c-b6b2c39993f6 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:43.553967 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:43.570101 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:43.586814 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59023e46-e69e-457c-bf0c-0af1f46ce9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:43.587999 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59023e46-e69e-457c-bf0c-0af1f46ce9ea None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:43.588272 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59023e46-e69e-457c-bf0c-0af1f46ce9ea None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:43.588540 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59023e46-e69e-457c-bf0c-0af1f46ce9ea None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:43.589115 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59023e46-e69e-457c-bf0c-0af1f46ce9ea None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:43.589339 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4f0e8-a1b0-445c-9caa-bb925aeeeafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:43.590056 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4f0e8-a1b0-445c-9caa-bb925aeeeafb None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:43.590338 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4f0e8-a1b0-445c-9caa-bb925aeeeafb None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:43.590508 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59023e46-e69e-457c-bf0c-0af1f46ce9ea None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:43.590614 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4f0e8-a1b0-445c-9caa-bb925aeeeafb None admin] PATH_INFO: `/v3/endpoints` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:43.591298 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4f0e8-a1b0-445c-9caa-bb925aeeeafb None admin] RBAC: Adding query filter params (interface=public, service_id=e40cbed4ed3e42e0a2fe064cf495f25a, region_id=RegionOne) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:43.591604 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4f0e8-a1b0-445c-9caa-bb925aeeeafb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:43.593015 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4f0e8-a1b0-445c-9caa-bb925aeeeafb None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:43.597966 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 386/772] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Aug 17 14:47:43 2022] GET /identity/v3/endpoints?service_id=e40cbed4ed3e42e0a2fe064cf495f25a&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:43.600069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-59023e46-e69e-457c-bf0c-0af1f46ce9ea None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 14:47:43.600069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:43.600069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:47:43.600069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:47:43.600069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:47:43.600069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:47:43.600069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:47:43.600069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:43.600069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 14:47:43.600069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:43.600069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:43.600069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:43.600069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:43.600069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:43.600069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:43.600069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:43.601051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:43.601051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:43.601051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:43.601051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:43.601051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:43.601051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:43.601051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:43.601051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:47:43.601051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:47:43.601051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:47:43.601051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:47:43.601051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:43.601051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:43.601051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:43.601051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:43.601051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:43.601051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:43.602139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:43.602139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:43.602139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:43.602139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:43.602139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:43.602139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:43.602139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:43.602139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:43.602139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:43.602139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:43.602139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:47:43.602139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:43.602139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 14:47:43.602139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:43.602139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 387/773] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Aug 17 14:47:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:47:43.604895 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4f0e8-a1b0-445c-9caa-bb925aeeeafb None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:43.607804 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59023e46-e69e-457c-bf0c-0af1f46ce9ea None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:43.702003 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4f0e8-a1b0-445c-9caa-bb925aeeeafb None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:43.707922 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59023e46-e69e-457c-bf0c-0af1f46ce9ea None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:43.735939 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c32ae-52a1-4a9a-bbbf-37788838cedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:43.736547 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c32ae-52a1-4a9a-bbbf-37788838cedd None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:43.736821 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c32ae-52a1-4a9a-bbbf-37788838cedd None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:43.737089 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c32ae-52a1-4a9a-bbbf-37788838cedd None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:43.737713 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c32ae-52a1-4a9a-bbbf-37788838cedd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:43.739093 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c32ae-52a1-4a9a-bbbf-37788838cedd None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:43.742128 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268692f3-cfbc-492b-a65c-7ce7e9fad669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:43.742718 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268692f3-cfbc-492b-a65c-7ce7e9fad669 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:43.742996 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268692f3-cfbc-492b-a65c-7ce7e9fad669 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:43.743326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268692f3-cfbc-492b-a65c-7ce7e9fad669 None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:43.743952 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268692f3-cfbc-492b-a65c-7ce7e9fad669 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:43.744282 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268692f3-cfbc-492b-a65c-7ce7e9fad669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:43.744910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 387/774] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Aug 17 14:47:43 2022] GET /identity/v3/services => generated 1498 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:47:43.745929 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268692f3-cfbc-492b-a65c-7ce7e9fad669 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:43.750751 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 388/775] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Aug 17 14:47:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:47:43.756591 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c32ae-52a1-4a9a-bbbf-37788838cedd None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:43.787816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:43.864068 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c32ae-52a1-4a9a-bbbf-37788838cedd None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:43.900281 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f452270-450c-4009-b2da-5c8643051095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:43.900931 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f452270-450c-4009-b2da-5c8643051095 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:43.901172 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f452270-450c-4009-b2da-5c8643051095 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:43.901437 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f452270-450c-4009-b2da-5c8643051095 None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:43.902143 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f452270-450c-4009-b2da-5c8643051095 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:43.902443 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f452270-450c-4009-b2da-5c8643051095 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:43.903806 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f452270-450c-4009-b2da-5c8643051095 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:43.909104 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 388/776] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Aug 17 14:47:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:43.915328 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268692f3-cfbc-492b-a65c-7ce7e9fad669 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:43.966253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:44.023849 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268692f3-cfbc-492b-a65c-7ce7e9fad669 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:44.058320 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74817a35-3d13-4921-ae33-2cf592e65525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:44.058915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74817a35-3d13-4921-ae33-2cf592e65525 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:44.059189 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74817a35-3d13-4921-ae33-2cf592e65525 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:44.059455 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74817a35-3d13-4921-ae33-2cf592e65525 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:44.060156 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74817a35-3d13-4921-ae33-2cf592e65525 None admin] RBAC: Adding query filter params (interface=public, service_id=921d92d27f9d40f6af090d1d3cefbb75, region_id=RegionOne) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:44.060459 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74817a35-3d13-4921-ae33-2cf592e65525 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:44.061856 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74817a35-3d13-4921-ae33-2cf592e65525 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:44.071402 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 389/777] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Aug 17 14:47:43 2022] GET /identity/v3/endpoints?service_id=921d92d27f9d40f6af090d1d3cefbb75&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:44.072568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f452270-450c-4009-b2da-5c8643051095 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:44.162459 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:44.171826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f452270-450c-4009-b2da-5c8643051095 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:44.204540 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e08e67-80aa-4597-ba44-eafd37cd86d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:44.205138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e08e67-80aa-4597-ba44-eafd37cd86d2 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:44.205413 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e08e67-80aa-4597-ba44-eafd37cd86d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:44.205681 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e08e67-80aa-4597-ba44-eafd37cd86d2 None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:44.206345 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e08e67-80aa-4597-ba44-eafd37cd86d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:44.207686 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e08e67-80aa-4597-ba44-eafd37cd86d2 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:44.213954 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 389/778] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Aug 17 14:47:44 2022] GET /identity/v3/services => generated 1498 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:47:45.966042 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa444757-2d49-4a55-aaba-3f099af4ab6c None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:45.966564 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa444757-2d49-4a55-aaba-3f099af4ab6c None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:45.966564 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa444757-2d49-4a55-aaba-3f099af4ab6c None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:45.967906 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 390/779] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:45.973244 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a525b-b2f0-469f-b72a-4751cdda99e0 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:45.973679 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a525b-b2f0-469f-b72a-4751cdda99e0 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:45.973810 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a525b-b2f0-469f-b72a-4751cdda99e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:45.992230 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-562a525b-b2f0-469f-b72a-4751cdda99e0 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:45.993404 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-562a525b-b2f0-469f-b72a-4751cdda99e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:46.058578 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 390/780] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:45 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:47:46.387166 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a525b-b2f0-469f-b72a-4751cdda99e0 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:46.387356 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b88f73-8c66-445f-a696-5ab8ca613d75 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:46.387356 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b88f73-8c66-445f-a696-5ab8ca613d75 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:46.387625 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b88f73-8c66-445f-a696-5ab8ca613d75 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:46.388935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 391/781] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:46.393835 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435755-3404-4f30-943b-5c16ebacadc2 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:46.394116 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435755-3404-4f30-943b-5c16ebacadc2 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:46.394387 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435755-3404-4f30-943b-5c16ebacadc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:46.412878 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-37435755-3404-4f30-943b-5c16ebacadc2 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:46.414104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-37435755-3404-4f30-943b-5c16ebacadc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:46.477521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:46.488988 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 392/782] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:46 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:47:46.493028 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a525b-b2f0-469f-b72a-4751cdda99e0 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:46.527773 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae551d-b170-4556-a854-64ce3c8cae41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:46.528391 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae551d-b170-4556-a854-64ce3c8cae41 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:46.528669 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae551d-b170-4556-a854-64ce3c8cae41 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:46.528940 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae551d-b170-4556-a854-64ce3c8cae41 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:46.529517 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae551d-b170-4556-a854-64ce3c8cae41 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:46.530919 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae551d-b170-4556-a854-64ce3c8cae41 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:46.539349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-7aae551d-b170-4556-a854-64ce3c8cae41 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 14:47:46.539349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:46.539349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:47:46.539349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:47:46.539349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:47:46.539349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:47:46.539349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:47:46.539349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:46.539349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 14:47:46.539349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:46.539349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:46.539349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:46.539349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:46.539349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:46.539349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:46.539349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:46.539349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:46.541249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:46.541249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:46.541249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:46.541249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:46.541249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:46.541249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:46.541249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:47:46.541249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:47:46.541249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:47:46.541249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:47:46.541249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:46.541249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:46.541249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:46.541249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:46.541249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:46.541249 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:46.542383 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:46.542383 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:46.542383 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:46.542383 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:46.542383 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:46.542383 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:46.542383 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:46.542383 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:46.542383 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:46.542383 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:46.542383 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:47:46.542383 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:46.542383 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 14:47:46.542383 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:46.542383 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 391/783] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:47:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:47:46.547086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37435755-3404-4f30-943b-5c16ebacadc2 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:46.589771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:46.647572 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37435755-3404-4f30-943b-5c16ebacadc2 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:46.681859 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042ae73-4b88-40a6-a538-00d396b565a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:46.682458 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042ae73-4b88-40a6-a538-00d396b565a7 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:46.682738 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042ae73-4b88-40a6-a538-00d396b565a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:46.683010 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042ae73-4b88-40a6-a538-00d396b565a7 None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:46.683633 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042ae73-4b88-40a6-a538-00d396b565a7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:46.683932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042ae73-4b88-40a6-a538-00d396b565a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:46.685285 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042ae73-4b88-40a6-a538-00d396b565a7 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:46.689880 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 393/784] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:47:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:46.695457 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae551d-b170-4556-a854-64ce3c8cae41 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:46.797199 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae551d-b170-4556-a854-64ce3c8cae41 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:46.820690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042ae73-4b88-40a6-a538-00d396b565a7 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:46.830363 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51b98a-4cf0-49ee-a7c3-8f2892185c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:46.830965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51b98a-4cf0-49ee-a7c3-8f2892185c11 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:46.831244 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51b98a-4cf0-49ee-a7c3-8f2892185c11 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:46.831515 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51b98a-4cf0-49ee-a7c3-8f2892185c11 None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:46.832143 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51b98a-4cf0-49ee-a7c3-8f2892185c11 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:46.832442 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51b98a-4cf0-49ee-a7c3-8f2892185c11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:46.833820 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51b98a-4cf0-49ee-a7c3-8f2892185c11 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:46.838499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 392/785] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Aug 17 14:47:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:47:46.844076 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51b98a-4cf0-49ee-a7c3-8f2892185c11 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:46.859589 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:46.922010 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042ae73-4b88-40a6-a538-00d396b565a7 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:46.924244 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:46.943674 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51b98a-4cf0-49ee-a7c3-8f2892185c11 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:46.982968 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c731e-7304-4a1b-966f-a7c3dbd2cadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:46.983617 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c731e-7304-4a1b-966f-a7c3dbd2cadb None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:46.983858 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c731e-7304-4a1b-966f-a7c3dbd2cadb None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:46.984328 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c731e-7304-4a1b-966f-a7c3dbd2cadb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:46.984915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c731e-7304-4a1b-966f-a7c3dbd2cadb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:46.986297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c731e-7304-4a1b-966f-a7c3dbd2cadb None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:47.004768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-f19c731e-7304-4a1b-966f-a7c3dbd2cadb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 14:47:47.004768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:47.004768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:47:47.004768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:47:47.004768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:47:47.004768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:47:47.004768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:47:47.004768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:47.004768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 14:47:47.004768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:47.004768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:47.004768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:47.004768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:47.004768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:47.004768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:47.004768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:47.011367 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:47.011367 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:47.011367 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:47.011367 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:47.011367 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:47.011367 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:47.011367 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:47.011367 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:47:47.011367 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:47:47.011367 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:47:47.011367 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:47:47.011367 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:47.011367 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:47.011367 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:47.011367 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:47.011367 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:47.011367 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:47.012283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:47.012283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:47.012283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:47.012283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:47.012283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:47.012283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:47.012283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:47.012283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:47.012283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:47.012283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:47.012283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:47:47.012283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:47.012283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 14:47:47.012283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:47.012283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 394/786] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Aug 17 14:47:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:47:47.013066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c731e-7304-4a1b-966f-a7c3dbd2cadb None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:47.016805 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8746e3-5b7d-4f48-b503-c5ebb8a80bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:47.017416 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8746e3-5b7d-4f48-b503-c5ebb8a80bd3 None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:47.017701 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8746e3-5b7d-4f48-b503-c5ebb8a80bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:47.018128 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8746e3-5b7d-4f48-b503-c5ebb8a80bd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:47.018791 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8746e3-5b7d-4f48-b503-c5ebb8a80bd3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:47.020153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8746e3-5b7d-4f48-b503-c5ebb8a80bd3 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:47.050286 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 393/787] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 17 14:47:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:47:47.143439 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c731e-7304-4a1b-966f-a7c3dbd2cadb None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:47.188744 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb56260-1c9d-4563-a6a0-91d2abf02304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:47.189278 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb56260-1c9d-4563-a6a0-91d2abf02304 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:47.189557 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb56260-1c9d-4563-a6a0-91d2abf02304 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:47.189871 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb56260-1c9d-4563-a6a0-91d2abf02304 None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:47.190518 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb56260-1c9d-4563-a6a0-91d2abf02304 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:47.190817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb56260-1c9d-4563-a6a0-91d2abf02304 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:47.192197 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb56260-1c9d-4563-a6a0-91d2abf02304 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:47.201852 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 395/788] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Aug 17 14:47:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:47.204565 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8746e3-5b7d-4f48-b503-c5ebb8a80bd3 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:47.288138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:47.320932 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8746e3-5b7d-4f48-b503-c5ebb8a80bd3 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:47.354288 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fef96-e956-437c-a0cb-c566069e5838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:47.354890 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fef96-e956-437c-a0cb-c566069e5838 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:47.355169 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fef96-e956-437c-a0cb-c566069e5838 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:47.355443 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fef96-e956-437c-a0cb-c566069e5838 None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:47.356073 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4fef96-e956-437c-a0cb-c566069e5838 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:47.356374 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4fef96-e956-437c-a0cb-c566069e5838 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:47.357739 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4fef96-e956-437c-a0cb-c566069e5838 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:47.362504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 394/789] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Aug 17 14:47:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:47:47.369114 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb56260-1c9d-4563-a6a0-91d2abf02304 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:47.398475 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:47.470358 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb56260-1c9d-4563-a6a0-91d2abf02304 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:47.504297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5de16-af82-457b-afa0-f666865607ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:47.504891 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5de16-af82-457b-afa0-f666865607ef None admin] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:47.505168 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5de16-af82-457b-afa0-f666865607ef None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:47.505437 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5de16-af82-457b-afa0-f666865607ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:47.506135 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5de16-af82-457b-afa0-f666865607ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:47.507490 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5de16-af82-457b-afa0-f666865607ef None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:47.533957 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 396/790] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 17 14:47:47 2022] POST /identity/v3/endpoints => generated 347 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:47:49.286786 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a96165-4f2f-433a-ae9c-f0b58342e4fc None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:49.287343 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a96165-4f2f-433a-ae9c-f0b58342e4fc None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:49.287343 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a96165-4f2f-433a-ae9c-f0b58342e4fc None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:49.288633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 395/791] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:49.293773 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49028609-3177-464f-bd68-a449f3419142 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:49.294195 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49028609-3177-464f-bd68-a449f3419142 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:49.294326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49028609-3177-464f-bd68-a449f3419142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:49.313122 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-49028609-3177-464f-bd68-a449f3419142 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:49.314333 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-49028609-3177-464f-bd68-a449f3419142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:49.390116 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 397/792] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:49 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:47:49.717324 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a96165-4f2f-433a-ae9c-f0b58342e4fc None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:49.737943 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fe27d-1b84-4bf9-978e-ac08bd52c95a None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:49.738221 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fe27d-1b84-4bf9-978e-ac08bd52c95a None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:49.738488 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fe27d-1b84-4bf9-978e-ac08bd52c95a None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:49.739797 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 398/793] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:49.745711 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5596c-a193-4124-b4b1-2dae80687cce None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:49.746012 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5596c-a193-4124-b4b1-2dae80687cce None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:49.746285 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5596c-a193-4124-b4b1-2dae80687cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:49.764728 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-a1d5596c-a193-4124-b4b1-2dae80687cce None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:49.765930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-a1d5596c-a193-4124-b4b1-2dae80687cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:49.768623 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:49.820940 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a96165-4f2f-433a-ae9c-f0b58342e4fc None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:49.833188 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 399/794] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:49 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:47:49.853931 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde48fb2-6e19-46cf-aa3a-b0d6fbff6d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:49.854521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde48fb2-6e19-46cf-aa3a-b0d6fbff6d58 None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:49.854798 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde48fb2-6e19-46cf-aa3a-b0d6fbff6d58 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:49.855067 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde48fb2-6e19-46cf-aa3a-b0d6fbff6d58 None admin] PATH_INFO: `/v3/projects` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:49.855705 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde48fb2-6e19-46cf-aa3a-b0d6fbff6d58 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:49.857127 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde48fb2-6e19-46cf-aa3a-b0d6fbff6d58 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:49.859681 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: WARNING keystone.server.flask.common [None req-dde48fb2-6e19-46cf-aa3a-b0d6fbff6d58 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 17 14:47:49.862872 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:49.878879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.sql.core [None req-dde48fb2-6e19-46cf-aa3a-b0d6fbff6d58 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 14:47:49.878879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 14:47:49.878879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [parameters: {'id': '2d8ea6744aec4c8d99002b9ac9ba1c6f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 14:47:49.878879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88156) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 14:47:49.894802 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-dde48fb2-6e19-46cf-aa3a-b0d6fbff6d58 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2d8ea6744aec4c8d99002b9ac9ba1c6f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2d8ea6744aec4c8d99002b9ac9ba1c6f. Aug 17 14:47:49.894802 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:49.894802 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 14:47:49.894802 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 14:47:49.894802 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 14:47:49.894802 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 14:47:49.894802 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 14:47:49.894802 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 14:47:49.894802 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 14:47:49.894802 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application conn.query(q) Aug 17 14:47:49.894802 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 14:47:49.894802 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 14:47:49.894802 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 14:47:49.895676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application result.read() Aug 17 14:47:49.895676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 14:47:49.895676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 14:47:49.895676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 14:47:49.895676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 14:47:49.895676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 14:47:49.895676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 14:47:49.895676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 14:47:49.895676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 14:47:49.895676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 14:47:49.895676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:49.895676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 14:47:49.895676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:49.895676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:49.895676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 14:47:49.895676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 14:47:49.895676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 17 14:47:49.895676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 17 14:47:49.896763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 14:47:49.896763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application next(self.gen) Aug 17 14:47:49.896763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 14:47:49.896763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application yield resource Aug 17 14:47:49.896763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 14:47:49.896763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application next(self.gen) Aug 17 14:47:49.896763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 14:47:49.896763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 14:47:49.896763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 14:47:49.896763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 14:47:49.896763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 14:47:49.896763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise self.value Aug 17 14:47:49.896763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 14:47:49.896763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 14:47:49.896763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 14:47:49.896763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application session.commit() Aug 17 14:47:49.896763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 14:47:49.897672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 14:47:49.897672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 14:47:49.897672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 14:47:49.897672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 14:47:49.897672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self.session.flush() Aug 17 14:47:49.897672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 14:47:49.897672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 14:47:49.897672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 14:47:49.897672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 14:47:49.897672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 14:47:49.897672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application compat.raise_( Aug 17 14:47:49.897672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 14:47:49.897672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception Aug 17 14:47:49.897672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 14:47:49.897672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 14:47:49.897672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 14:47:49.897672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 14:47:49.898637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 14:47:49.898637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 14:47:49.898637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 14:47:49.898637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 14:47:49.898637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 14:47:49.898637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 14:47:49.898637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 14:47:49.898637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 14:47:49.898637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 14:47:49.898637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 14:47:49.898637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 14:47:49.898637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 14:47:49.898637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 14:47:49.898637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 14:47:49.898637 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 14:47:49.899494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 14:47:49.899494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 14:47:49.899494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception Aug 17 14:47:49.899494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 14:47:49.899494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 14:47:49.899494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 14:47:49.899494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 14:47:49.899494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 14:47:49.899494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 14:47:49.899494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 14:47:49.899494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application conn.query(q) Aug 17 14:47:49.899494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 14:47:49.899494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 14:47:49.899494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 14:47:49.899494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application result.read() Aug 17 14:47:49.899494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 14:47:49.899494 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 14:47:49.900420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 14:47:49.900420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 14:47:49.900420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 14:47:49.900420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 14:47:49.900420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 14:47:49.900420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 14:47:49.900420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 14:47:49.900420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 14:47:49.900420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [parameters: {'id': '2d8ea6744aec4c8d99002b9ac9ba1c6f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 14:47:49.900420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 14:47:49.900420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:49.900420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:49.900420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:49.900420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:49.900420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 17 14:47:49.901218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 17 14:47:49.901218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 14:47:49.901218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 14:47:49.901218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 17 14:47:49.901218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:49.901218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:49.901218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:49.901218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:49.901218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:49.901218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:49.901218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:49.901218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:49.901218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:49.901218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:49.901218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:49.901218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:49.901218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:49.903830 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:49.903830 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 17 14:47:49.903830 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 17 14:47:49.903830 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:49.903830 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:49.903830 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 17 14:47:49.903830 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 17 14:47:49.903830 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2d8ea6744aec4c8d99002b9ac9ba1c6f. Aug 17 14:47:49.903830 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:49.903830 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 396/795] 10.222.0.30 () {60 vars in 1140 bytes} [Wed Aug 17 14:47:49 2022] POST /identity/v3/projects => generated 262 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:49.904935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5596c-a193-4124-b4b1-2dae80687cce None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:50.000504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5596c-a193-4124-b4b1-2dae80687cce None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:50.034848 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4cc5e-7945-4230-bbc4-2c93fa6eb66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:50.035458 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4cc5e-7945-4230-bbc4-2c93fa6eb66c None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:50.035734 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4cc5e-7945-4230-bbc4-2c93fa6eb66c None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:50.036004 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4cc5e-7945-4230-bbc4-2c93fa6eb66c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:50.042950 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4cc5e-7945-4230-bbc4-2c93fa6eb66c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:50.044379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4cc5e-7945-4230-bbc4-2c93fa6eb66c None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:50.047128 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:50.056848 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-81c4cc5e-7945-4230-bbc4-2c93fa6eb66c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:50.056848 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:50.056848 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:50.056848 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:50.056848 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:50.056848 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:50.056848 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:50.056848 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:50.056848 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:50.056848 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:50.056848 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:50.056848 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:50.056848 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:47:50.056848 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:47:50.056848 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:47:50.057764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:47:50.057764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:50.057764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:50.057764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:50.057764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:50.057764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:50.057764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:50.057764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:50.057764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:50.057764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:50.057764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:50.057764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:50.057764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:50.057764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:50.057764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:50.057764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:50.057764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:50.058653 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:47:50.058653 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:47:50.058653 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:47:50.058653 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:47:50.058653 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:47:50.058653 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:47:50.058653 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:47:50.058653 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:50.061894 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 400/796] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:50.064002 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde48fb2-6e19-46cf-aa3a-b0d6fbff6d58 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:50.163776 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde48fb2-6e19-46cf-aa3a-b0d6fbff6d58 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:50.164055 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4cc5e-7945-4230-bbc4-2c93fa6eb66c None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:50.204981 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d6cfc-2833-4dd9-ae93-34ab55d7402a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:50.205590 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d6cfc-2833-4dd9-ae93-34ab55d7402a None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:50.205905 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d6cfc-2833-4dd9-ae93-34ab55d7402a None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:50.206181 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d6cfc-2833-4dd9-ae93-34ab55d7402a None admin] PATH_INFO: `/v3/projects` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:50.206847 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d6cfc-2833-4dd9-ae93-34ab55d7402a None admin] RBAC: Adding query filter params (name=service) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:50.207149 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d6cfc-2833-4dd9-ae93-34ab55d7402a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:50.208783 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d6cfc-2833-4dd9-ae93-34ab55d7402a None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:50.230516 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 397/797] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 17 14:47:50 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:50.274687 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4cc5e-7945-4230-bbc4-2c93fa6eb66c None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:50.310854 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e40ee-0644-4ba0-a2e8-47b973162665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:50.311544 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e40ee-0644-4ba0-a2e8-47b973162665 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:50.311761 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e40ee-0644-4ba0-a2e8-47b973162665 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:50.312034 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e40ee-0644-4ba0-a2e8-47b973162665 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:50.312634 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e40ee-0644-4ba0-a2e8-47b973162665 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:50.314046 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e40ee-0644-4ba0-a2e8-47b973162665 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:50.323928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-249e40ee-0644-4ba0-a2e8-47b973162665 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 14:47:50.323928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:50.323928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:47:50.323928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:47:50.323928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:47:50.323928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:47:50.323928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:47:50.323928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:50.323928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 14:47:50.323928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:50.323928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:50.323928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:50.323928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:50.323928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:50.323928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:50.323928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:50.323928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:50.325155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:50.325155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:50.325155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:50.325155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:50.325155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:50.325155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:50.325155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:47:50.325155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:47:50.325155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:47:50.325155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:47:50.325155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:50.325155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:50.325155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:50.325155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:50.325155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:50.325155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:50.326026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:50.326026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:50.326026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:50.326026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:50.326026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:50.326026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:50.326026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:50.326026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:50.326026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:50.326026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:50.326026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:47:50.326026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:50.326026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 14:47:50.326026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:50.329901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 401/798] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:47:50.331287 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d6cfc-2833-4dd9-ae93-34ab55d7402a None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:50.385469 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:50.443306 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d6cfc-2833-4dd9-ae93-34ab55d7402a None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:50.479919 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943de7e1-ddae-4cdb-add0-aabd794f02d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:50.480549 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943de7e1-ddae-4cdb-add0-aabd794f02d6 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:50.480816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943de7e1-ddae-4cdb-add0-aabd794f02d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:50.481077 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943de7e1-ddae-4cdb-add0-aabd794f02d6 None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:50.481701 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943de7e1-ddae-4cdb-add0-aabd794f02d6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:50.482015 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943de7e1-ddae-4cdb-add0-aabd794f02d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:50.483353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943de7e1-ddae-4cdb-add0-aabd794f02d6 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:50.488176 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 398/799] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 17 14:47:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:50.496368 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e40ee-0644-4ba0-a2e8-47b973162665 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:50.566478 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:50.604731 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e40ee-0644-4ba0-a2e8-47b973162665 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:50.638709 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934dbff-794f-4fef-ab53-14f7e00fc939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:50.639305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934dbff-794f-4fef-ab53-14f7e00fc939 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:50.639582 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934dbff-794f-4fef-ab53-14f7e00fc939 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:50.639853 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934dbff-794f-4fef-ab53-14f7e00fc939 None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:50.640480 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934dbff-794f-4fef-ab53-14f7e00fc939 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:50.640781 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934dbff-794f-4fef-ab53-14f7e00fc939 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:50.642169 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934dbff-794f-4fef-ab53-14f7e00fc939 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:50.646485 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 402/800] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 17 14:47:50 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:52.485458 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebfc2b-c1f2-4b51-a1c2-06009c120e33 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:52.486019 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebfc2b-c1f2-4b51-a1c2-06009c120e33 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:52.487580 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebfc2b-c1f2-4b51-a1c2-06009c120e33 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:52.488604 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 399/801] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:52.494782 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecdc38-506f-4e44-afd1-e19124d5d9b0 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:52.495455 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecdc38-506f-4e44-afd1-e19124d5d9b0 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:52.495584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecdc38-506f-4e44-afd1-e19124d5d9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:52.513898 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-9aecdc38-506f-4e44-afd1-e19124d5d9b0 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:52.515057 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-9aecdc38-506f-4e44-afd1-e19124d5d9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:52.585324 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 403/802] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:52 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:47:52.820242 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a331ff-3e87-4a89-bd7a-c10ac35ea78c None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:52.820451 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a331ff-3e87-4a89-bd7a-c10ac35ea78c None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:52.820724 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a331ff-3e87-4a89-bd7a-c10ac35ea78c None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:52.822103 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 400/803] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:52.827244 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f4a1c-fa24-4ab0-8eba-23998316e7d8 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:52.827529 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f4a1c-fa24-4ab0-8eba-23998316e7d8 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:52.827805 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f4a1c-fa24-4ab0-8eba-23998316e7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:52.845372 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-fa7f4a1c-fa24-4ab0-8eba-23998316e7d8 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:52.846583 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-fa7f4a1c-fa24-4ab0-8eba-23998316e7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:52.900489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:52.918523 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 404/804] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:52 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:47:52.921463 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a331ff-3e87-4a89-bd7a-c10ac35ea78c None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:53.021265 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a331ff-3e87-4a89-bd7a-c10ac35ea78c None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:53.035624 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:53.056556 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb67ec1-05a9-4314-933c-4f12ca27d37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:53.057144 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb67ec1-05a9-4314-933c-4f12ca27d37f None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:53.057418 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb67ec1-05a9-4314-933c-4f12ca27d37f None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:53.057679 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb67ec1-05a9-4314-933c-4f12ca27d37f None admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:53.058343 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb67ec1-05a9-4314-933c-4f12ca27d37f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:53.059746 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb67ec1-05a9-4314-933c-4f12ca27d37f None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:53.074170 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.sql.core [None req-eeb67ec1-05a9-4314-933c-4f12ca27d37f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 14:47:53.074170 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 14:47:53.074170 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [parameters: {'user_id': '32dc05ab6d904c02aaf080d5e687bed0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 14:47:53.074170 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88156) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 14:47:53.080327 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-eeb67ec1-05a9-4314-933c-4f12ca27d37f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 14:47:53.080327 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:53.080327 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 14:47:53.080327 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 14:47:53.080327 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 14:47:53.080327 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 14:47:53.080327 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 14:47:53.080327 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 14:47:53.080327 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 14:47:53.080327 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application conn.query(q) Aug 17 14:47:53.080327 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 14:47:53.080327 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 14:47:53.080327 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 14:47:53.080327 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application result.read() Aug 17 14:47:53.080327 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 14:47:53.081399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 14:47:53.081399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 14:47:53.081399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 14:47:53.081399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 14:47:53.081399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 14:47:53.081399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 14:47:53.081399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 14:47:53.081399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 14:47:53.081399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:53.081399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 14:47:53.081399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:53.081399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:53.081399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 14:47:53.081399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 14:47:53.081399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 17 14:47:53.081399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 17 14:47:53.081399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 14:47:53.081399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application next(self.gen) Aug 17 14:47:53.082447 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 14:47:53.082447 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application yield resource Aug 17 14:47:53.082447 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 14:47:53.082447 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application next(self.gen) Aug 17 14:47:53.082447 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 14:47:53.082447 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 14:47:53.082447 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 14:47:53.082447 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 14:47:53.082447 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 14:47:53.082447 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise self.value Aug 17 14:47:53.082447 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 14:47:53.082447 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 14:47:53.082447 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 14:47:53.082447 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application session.commit() Aug 17 14:47:53.082447 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 14:47:53.082447 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 14:47:53.082447 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 14:47:53.083353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 14:47:53.083353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 14:47:53.083353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self.session.flush() Aug 17 14:47:53.083353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 14:47:53.083353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 14:47:53.083353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 14:47:53.083353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 14:47:53.083353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 14:47:53.083353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application compat.raise_( Aug 17 14:47:53.083353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 14:47:53.083353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception Aug 17 14:47:53.083353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 14:47:53.083353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 14:47:53.083353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 14:47:53.083353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 14:47:53.083353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 14:47:53.083353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 14:47:53.084243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 14:47:53.084243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 14:47:53.084243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 17 14:47:53.084243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 17 14:47:53.084243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 14:47:53.084243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 14:47:53.084243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 14:47:53.084243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 14:47:53.084243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 14:47:53.084243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 14:47:53.084243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 14:47:53.084243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 14:47:53.084243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 14:47:53.084243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 14:47:53.084243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 14:47:53.084243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception Aug 17 14:47:53.085075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 14:47:53.085075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 14:47:53.085075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 14:47:53.085075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 14:47:53.085075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 14:47:53.085075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 14:47:53.085075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 14:47:53.085075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application conn.query(q) Aug 17 14:47:53.085075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 14:47:53.085075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 14:47:53.085075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 14:47:53.085075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application result.read() Aug 17 14:47:53.085075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 14:47:53.085075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 14:47:53.085075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 14:47:53.085075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 14:47:53.086859 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 14:47:53.086859 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 14:47:53.086859 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 14:47:53.086859 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 14:47:53.086859 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 14:47:53.086859 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 14:47:53.086859 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [parameters: {'user_id': '32dc05ab6d904c02aaf080d5e687bed0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 14:47:53.086859 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 14:47:53.086859 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:53.086859 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:53.086859 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:53.086859 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:53.086859 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:53.086859 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:53.086859 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:53.088654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:53.088654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:53.088654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:53.088654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:53.088654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:53.088654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:53.088654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:53.088654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 17 14:47:53.088654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 17 14:47:53.088654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:53.088654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:53.088654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:47:53.088654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:53.088654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:47:53.088654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:53.088654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 17 14:47:53.088654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 17 14:47:53.090000 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 17 14:47:53.090000 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 17 14:47:53.090000 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 14:47:53.090000 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 14:47:53.090000 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 14:47:53.090000 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:53.090000 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 401/805] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Aug 17 14:47:52 2022] POST /identity/v3/users => generated 160 bytes in 160 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:53.090493 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f4a1c-fa24-4ab0-8eba-23998316e7d8 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:53.189572 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f4a1c-fa24-4ab0-8eba-23998316e7d8 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:53.225234 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a1c37-ddd6-4995-bfd0-057337bf2500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:53.225942 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a1c37-ddd6-4995-bfd0-057337bf2500 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:53.226219 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a1c37-ddd6-4995-bfd0-057337bf2500 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:53.226484 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a1c37-ddd6-4995-bfd0-057337bf2500 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:53.234289 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a1c37-ddd6-4995-bfd0-057337bf2500 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:53.235695 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a1c37-ddd6-4995-bfd0-057337bf2500 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:53.247584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-e48a1c37-ddd6-4995-bfd0-057337bf2500 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 14:47:53.247584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:53.247584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:53.247584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:53.247584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:53.247584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:53.247584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:53.247584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:53.247584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:53.247584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:53.247584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:53.247584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:53.247584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:47:53.247584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:47:53.247584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:47:53.247584 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:47:53.248817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:53.248817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:53.248817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:47:53.248817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:53.248817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:47:53.248817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:47:53.248817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:53.248817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:53.248817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:53.248817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:53.248817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:53.248817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:53.248817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:53.248817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:53.248817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:53.248817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:53.248817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:53.248817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:53.250057 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:53.250057 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:53.250057 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:47:53.250057 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:47:53.250057 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:47:53.250057 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:47:53.250057 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:47:53.250057 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:47:53.250057 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 14:47:53.250057 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:53.250887 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 405/806] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:47:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:53.253325 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb67ec1-05a9-4314-933c-4f12ca27d37f None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:53.254105 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a1c37-ddd6-4995-bfd0-057337bf2500 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:53.303591 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:53.354178 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb67ec1-05a9-4314-933c-4f12ca27d37f None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:53.359585 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a1c37-ddd6-4995-bfd0-057337bf2500 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:53.388580 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19d2bb-5a4f-438a-8049-bf744558eee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:53.389179 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19d2bb-5a4f-438a-8049-bf744558eee1 None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:53.389459 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19d2bb-5a4f-438a-8049-bf744558eee1 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:53.389739 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19d2bb-5a4f-438a-8049-bf744558eee1 None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:53.390416 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19d2bb-5a4f-438a-8049-bf744558eee1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:53.391963 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19d2bb-5a4f-438a-8049-bf744558eee1 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:53.394314 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591916b-42b5-4239-be27-945cfc4d7ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:53.394908 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591916b-42b5-4239-be27-945cfc4d7ee7 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:53.395355 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591916b-42b5-4239-be27-945cfc4d7ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:53.395632 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591916b-42b5-4239-be27-945cfc4d7ee7 None admin] PATH_INFO: `/v3/users` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:53.396731 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f591916b-42b5-4239-be27-945cfc4d7ee7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:53.396992 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f591916b-42b5-4239-be27-945cfc4d7ee7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:53.398636 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f591916b-42b5-4239-be27-945cfc4d7ee7 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:53.409455 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 402/807] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 17 14:47:53 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:47:53.438225 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 406/808] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Aug 17 14:47:53 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:55.642797 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c4468-d759-4da3-932e-a04718734bb7 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:55.643305 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c4468-d759-4da3-932e-a04718734bb7 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:55.643391 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c4468-d759-4da3-932e-a04718734bb7 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:55.644667 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 403/809] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:55.649986 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673bcd9-bd2d-4987-a931-054613ec2ce1 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:55.650423 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673bcd9-bd2d-4987-a931-054613ec2ce1 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:55.650516 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673bcd9-bd2d-4987-a931-054613ec2ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:55.668502 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-6673bcd9-bd2d-4987-a931-054613ec2ce1 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:55.669670 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-6673bcd9-bd2d-4987-a931-054613ec2ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:55.740291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 407/810] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:55 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:47:56.068687 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c4468-d759-4da3-932e-a04718734bb7 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:56.104911 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:56.169483 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c4468-d759-4da3-932e-a04718734bb7 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:56.203373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b59253-d1ab-4ed0-88d7-920c2e64b5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:56.203990 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b59253-d1ab-4ed0-88d7-920c2e64b5dd None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:56.204267 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b59253-d1ab-4ed0-88d7-920c2e64b5dd None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:56.204535 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b59253-d1ab-4ed0-88d7-920c2e64b5dd None admin] PATH_INFO: `/v3/services/compute` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:56.205113 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b59253-d1ab-4ed0-88d7-920c2e64b5dd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:56.206493 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b59253-d1ab-4ed0-88d7-920c2e64b5dd None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:56.215489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-f8b59253-d1ab-4ed0-88d7-920c2e64b5dd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 14:47:56.215489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:56.215489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:47:56.215489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:47:56.215489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:47:56.215489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:47:56.215489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:47:56.215489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:56.215489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 14:47:56.215489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:56.215489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:56.215489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:56.215489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:56.215489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:56.215489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:56.215489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:56.215489 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:56.216617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:56.216617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:56.216617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:56.216617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:56.216617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:56.216617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:56.216617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:47:56.216617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:47:56.216617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:47:56.216617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:47:56.216617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:56.216617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:56.216617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:56.216617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:56.216617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:56.216617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:56.217444 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:56.217444 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:56.217444 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:56.217444 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:56.217444 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:56.217444 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:56.217444 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:56.217444 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:56.217444 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:56.217444 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:56.217444 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:47:56.217444 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:56.217444 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 14:47:56.217444 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:47:56.217444 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 404/811] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:56.222654 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673bcd9-bd2d-4987-a931-054613ec2ce1 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:56.252705 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:56.318909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673bcd9-bd2d-4987-a931-054613ec2ce1 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:56.351440 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd106b1a-e9a1-4dd6-ba57-6ce9d075626f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:56.352026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd106b1a-e9a1-4dd6-ba57-6ce9d075626f None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:56.352301 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd106b1a-e9a1-4dd6-ba57-6ce9d075626f None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:56.353137 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd106b1a-e9a1-4dd6-ba57-6ce9d075626f None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:56.353817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd106b1a-e9a1-4dd6-ba57-6ce9d075626f None admin] RBAC: Adding query filter params (name=compute) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:56.354122 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd106b1a-e9a1-4dd6-ba57-6ce9d075626f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:56.355468 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd106b1a-e9a1-4dd6-ba57-6ce9d075626f None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:56.360041 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 408/812] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 17 14:47:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:56.365839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b59253-d1ab-4ed0-88d7-920c2e64b5dd None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:56.461710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:56.464982 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b59253-d1ab-4ed0-88d7-920c2e64b5dd None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:56.504011 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee1733-a100-41fe-ba1d-5388f03fa942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:56.504603 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee1733-a100-41fe-ba1d-5388f03fa942 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:56.504880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee1733-a100-41fe-ba1d-5388f03fa942 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:56.505144 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee1733-a100-41fe-ba1d-5388f03fa942 None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:56.506506 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee1733-a100-41fe-ba1d-5388f03fa942 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:56.506805 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee1733-a100-41fe-ba1d-5388f03fa942 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:56.510291 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee1733-a100-41fe-ba1d-5388f03fa942 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:56.517901 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 405/813] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 17 14:47:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:56.523930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd106b1a-e9a1-4dd6-ba57-6ce9d075626f None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:56.617763 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:56.624838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd106b1a-e9a1-4dd6-ba57-6ce9d075626f None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:56.657896 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efd611-61c1-438c-8500-57cf88a2b51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:56.658473 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efd611-61c1-438c-8500-57cf88a2b51c None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:56.658748 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efd611-61c1-438c-8500-57cf88a2b51c None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:56.659013 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efd611-61c1-438c-8500-57cf88a2b51c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:56.659700 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efd611-61c1-438c-8500-57cf88a2b51c None admin] RBAC: Adding query filter params (interface=public, service_id=128c0d41253446d8a3f2aaec1aa9a6c2, region_id=RegionOne) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:56.660001 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efd611-61c1-438c-8500-57cf88a2b51c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:56.661339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efd611-61c1-438c-8500-57cf88a2b51c None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:56.666800 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 409/814] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Aug 17 14:47:56 2022] GET /identity/v3/endpoints?service_id=128c0d41253446d8a3f2aaec1aa9a6c2&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:56.672567 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee1733-a100-41fe-ba1d-5388f03fa942 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:56.769491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee1733-a100-41fe-ba1d-5388f03fa942 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:56.802848 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99243596-f00a-4202-906b-853d47ca6ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:56.803431 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99243596-f00a-4202-906b-853d47ca6ddc None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:56.803706 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99243596-f00a-4202-906b-853d47ca6ddc None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:56.803973 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99243596-f00a-4202-906b-853d47ca6ddc None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:56.804565 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99243596-f00a-4202-906b-853d47ca6ddc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:56.806144 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99243596-f00a-4202-906b-853d47ca6ddc None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:56.812132 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 406/815] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Aug 17 14:47:56 2022] GET /identity/v3/services => generated 1728 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:47:59.003930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f61924-d59d-4136-b03e-d7f505cbeac8 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:59.004470 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f61924-d59d-4136-b03e-d7f505cbeac8 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:59.004470 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f61924-d59d-4136-b03e-d7f505cbeac8 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:59.005843 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 410/816] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:47:59.011015 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a31f9-91f0-44a4-8256-6c92b392a735 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:59.011431 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a31f9-91f0-44a4-8256-6c92b392a735 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:59.011547 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a31f9-91f0-44a4-8256-6c92b392a735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:59.030049 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-f51a31f9-91f0-44a4-8256-6c92b392a735 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:47:59.031532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-f51a31f9-91f0-44a4-8256-6c92b392a735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:47:59.054357 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:59.097694 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 407/817] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:47:59 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:47:59.425782 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f61924-d59d-4136-b03e-d7f505cbeac8 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:59.527119 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f61924-d59d-4136-b03e-d7f505cbeac8 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:59.560664 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b78c4-d7a8-47a7-800f-6bce502c4a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:59.561288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b78c4-d7a8-47a7-800f-6bce502c4a92 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:59.561559 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b78c4-d7a8-47a7-800f-6bce502c4a92 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:59.561866 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b78c4-d7a8-47a7-800f-6bce502c4a92 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:59.562445 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b78c4-d7a8-47a7-800f-6bce502c4a92 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:59.563784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b78c4-d7a8-47a7-800f-6bce502c4a92 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:59.573024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-bf6b78c4-d7a8-47a7-800f-6bce502c4a92 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 14:47:59.573024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:59.573024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:47:59.573024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:47:59.573024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:47:59.573024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:47:59.573024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:47:59.573024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:59.573024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 14:47:59.573024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:59.573024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:47:59.573024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:59.573024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:47:59.573024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:47:59.573024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:47:59.573024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:47:59.573024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:47:59.574163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:47:59.574163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:47:59.574163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:47:59.574163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:47:59.574163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:47:59.574163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:47:59.574163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:47:59.574163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:47:59.574163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:47:59.574163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:47:59.574163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:47:59.574163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:47:59.574163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:47:59.574163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:47:59.574163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:47:59.574163 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:47:59.575014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:47:59.575014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:47:59.575014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:47:59.575014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:47:59.575014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:47:59.575014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:47:59.575014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:47:59.575014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:47:59.575014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:47:59.575014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:47:59.575014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:47:59.575014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:47:59.575014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 14:47:59.575014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:47:59.575014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 411/818] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:47:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:47:59.580010 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a31f9-91f0-44a4-8256-6c92b392a735 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:59.676297 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a31f9-91f0-44a4-8256-6c92b392a735 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:59.709205 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479939ba-17b5-4a12-a7d7-3889c73ebf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:59.709829 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479939ba-17b5-4a12-a7d7-3889c73ebf98 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:59.710113 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479939ba-17b5-4a12-a7d7-3889c73ebf98 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:59.710387 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479939ba-17b5-4a12-a7d7-3889c73ebf98 None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:59.711013 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479939ba-17b5-4a12-a7d7-3889c73ebf98 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:59.711312 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479939ba-17b5-4a12-a7d7-3889c73ebf98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:59.713263 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479939ba-17b5-4a12-a7d7-3889c73ebf98 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:59.717878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 408/819] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 17 14:47:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:59.723758 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b78c4-d7a8-47a7-800f-6bce502c4a92 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:59.749614 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:59.824402 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b78c4-d7a8-47a7-800f-6bce502c4a92 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:47:59.859817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ffac5-4d2d-4476-859b-1be6ee4ab5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:47:59.860403 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ffac5-4d2d-4476-859b-1be6ee4ab5e6 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:47:59.860679 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ffac5-4d2d-4476-859b-1be6ee4ab5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:47:59.860947 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ffac5-4d2d-4476-859b-1be6ee4ab5e6 None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:47:59.861600 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ffac5-4d2d-4476-859b-1be6ee4ab5e6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:47:59.861929 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ffac5-4d2d-4476-859b-1be6ee4ab5e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:47:59.863278 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ffac5-4d2d-4476-859b-1be6ee4ab5e6 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:47:59.868509 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 412/820] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Aug 17 14:47:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:47:59.874707 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479939ba-17b5-4a12-a7d7-3889c73ebf98 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:47:59.899262 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:47:59.972813 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479939ba-17b5-4a12-a7d7-3889c73ebf98 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:48:00.005994 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a3337-4ff5-4ce5-b523-c6f941a1a825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:48:00.006582 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a3337-4ff5-4ce5-b523-c6f941a1a825 None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:48:00.006862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a3337-4ff5-4ce5-b523-c6f941a1a825 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:48:00.007133 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a3337-4ff5-4ce5-b523-c6f941a1a825 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:48:00.007793 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a3337-4ff5-4ce5-b523-c6f941a1a825 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:48:00.009692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a3337-4ff5-4ce5-b523-c6f941a1a825 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:48:00.028244 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 409/821] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 17 14:47:59 2022] POST /identity/v3/endpoints => generated 334 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:48:09.865703 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=56 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:48:10.024187 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=60,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:02.964637 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857648b-43fc-4c63-8ace-e7b61b6fd63f None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:02.965238 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857648b-43fc-4c63-8ace-e7b61b6fd63f None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:02.965238 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857648b-43fc-4c63-8ace-e7b61b6fd63f None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:02.966704 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 413/822] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:49:02.974192 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a8339-1f4f-4f6f-8e5e-48be9cca0495 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:02.974761 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a8339-1f4f-4f6f-8e5e-48be9cca0495 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:02.974761 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a8339-1f4f-4f6f-8e5e-48be9cca0495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:02.996490 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-098a8339-1f4f-4f6f-8e5e-48be9cca0495 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:49:02.997851 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-098a8339-1f4f-4f6f-8e5e-48be9cca0495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:49:03.090747 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 410/823] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:49:02 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:49:03.446205 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857648b-43fc-4c63-8ace-e7b61b6fd63f None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:03.585226 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857648b-43fc-4c63-8ace-e7b61b6fd63f None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:03.630337 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f70331-df32-4161-a0ba-501ed5cf96a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:03.632097 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f70331-df32-4161-a0ba-501ed5cf96a5 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:03.632430 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f70331-df32-4161-a0ba-501ed5cf96a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:03.632853 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f70331-df32-4161-a0ba-501ed5cf96a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:03.650154 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f70331-df32-4161-a0ba-501ed5cf96a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:03.651897 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f70331-df32-4161-a0ba-501ed5cf96a5 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:03.670371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-a6f70331-df32-4161-a0ba-501ed5cf96a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:03.670371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:03.670371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:03.670371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:03.670371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:03.670371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:03.670371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:03.670371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:03.670371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:03.670371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:03.670371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:03.670371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:03.670371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:49:03.670371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:49:03.670371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:49:03.670371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:49:03.671657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:03.671657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:03.671657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:03.671657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:03.671657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:03.671657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:03.671657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:03.671657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:03.671657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:03.671657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:03.671657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:03.671657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:03.671657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:03.671657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:03.671657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:03.671657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:03.671657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:49:03.672949 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:49:03.672949 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:03.672949 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:49:03.672949 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 414/824] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:49:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:03.679248 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a8339-1f4f-4f6f-8e5e-48be9cca0495 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:03.798883 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a8339-1f4f-4f6f-8e5e-48be9cca0495 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:03.830994 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:03.841534 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5b065-3a48-4e19-8893-af33f5e94cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:03.842175 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5b065-3a48-4e19-8893-af33f5e94cef None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:03.842450 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5b065-3a48-4e19-8893-af33f5e94cef None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:03.842717 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5b065-3a48-4e19-8893-af33f5e94cef None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:03.843435 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5b065-3a48-4e19-8893-af33f5e94cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:03.843733 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5b065-3a48-4e19-8893-af33f5e94cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:03.845179 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5b065-3a48-4e19-8893-af33f5e94cef None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:03.858909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 411/825] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:03.864483 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f70331-df32-4161-a0ba-501ed5cf96a5 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:03.927763 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:03.984728 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f70331-df32-4161-a0ba-501ed5cf96a5 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:04.031379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e22ee-5ff4-4c13-9908-cfc52db8946a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:04.032101 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e22ee-5ff4-4c13-9908-cfc52db8946a None admin] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:04.032455 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e22ee-5ff4-4c13-9908-cfc52db8946a None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:04.032729 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e22ee-5ff4-4c13-9908-cfc52db8946a None admin] PATH_INFO: `/v3/users` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:04.033435 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e22ee-5ff4-4c13-9908-cfc52db8946a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:04.034895 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e22ee-5ff4-4c13-9908-cfc52db8946a None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:04.064317 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 415/826] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Aug 17 14:49:03 2022] POST /identity/v3/users => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:49:06.512194 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739e0fb-7733-45d2-a5e3-fbe653ae04fe None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:06.512826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739e0fb-7733-45d2-a5e3-fbe653ae04fe None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:06.512826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739e0fb-7733-45d2-a5e3-fbe653ae04fe None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:06.517791 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 412/827] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:49:06.521398 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf6976-e3e5-42e7-8562-34e10821797b None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:06.522010 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf6976-e3e5-42e7-8562-34e10821797b None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:06.523451 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf6976-e3e5-42e7-8562-34e10821797b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:06.544555 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-f7cf6976-e3e5-42e7-8562-34e10821797b None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:49:06.546040 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-f7cf6976-e3e5-42e7-8562-34e10821797b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:49:06.625155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 416/828] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:49:06 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:49:06.997569 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739e0fb-7733-45d2-a5e3-fbe653ae04fe None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:07.119150 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739e0fb-7733-45d2-a5e3-fbe653ae04fe None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:07.155463 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b4c15-7446-4c88-b4b7-1f974325ad2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:07.156085 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b4c15-7446-4c88-b4b7-1f974325ad2c None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:07.156359 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b4c15-7446-4c88-b4b7-1f974325ad2c None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:07.156629 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b4c15-7446-4c88-b4b7-1f974325ad2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:07.170651 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b4c15-7446-4c88-b4b7-1f974325ad2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:49:07.175568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-ff6b4c15-7446-4c88-b4b7-1f974325ad2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:49:07.175568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:07.175568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:07.175568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:07.175568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:07.175568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:07.175568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:07.175568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:07.175568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:07.175568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:07.175568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:07.175568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:07.175568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:49:07.175568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:49:07.175568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:49:07.175568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:49:07.176862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:49:07.176862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:49:07.176862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:49:07.176862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:49:07.176862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:07.176862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:07.176862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:07.176862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:07.176862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:07.176862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:07.176862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:07.176862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:07.176862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:07.176862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:07.176862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:07.176862 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:07.178676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:07.178676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:07.178676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:07.178676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:07.178676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:49:07.178676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:49:07.178676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:49:07.178676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:49:07.178676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:49:07.178676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:49:07.178676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:49:07.178676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:07.178676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 413/829] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 17 14:49:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:07.183987 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf6976-e3e5-42e7-8562-34e10821797b None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:07.230148 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:07.302509 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf6976-e3e5-42e7-8562-34e10821797b None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:07.341775 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c332efc-334e-4994-998c-9424a7d1cc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:07.342387 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c332efc-334e-4994-998c-9424a7d1cc55 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:07.342678 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c332efc-334e-4994-998c-9424a7d1cc55 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:07.343012 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c332efc-334e-4994-998c-9424a7d1cc55 None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:07.343732 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c332efc-334e-4994-998c-9424a7d1cc55 None admin] RBAC: Adding query filter params (name=service) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:07.344029 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c332efc-334e-4994-998c-9424a7d1cc55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:07.345677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c332efc-334e-4994-998c-9424a7d1cc55 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:07.355394 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 417/830] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 17 14:49:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:07.361860 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b4c15-7446-4c88-b4b7-1f974325ad2c None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:07.413556 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:07.474236 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b4c15-7446-4c88-b4b7-1f974325ad2c None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:07.509376 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd293c-3a78-4219-8adc-6feee14fa95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:07.510029 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd293c-3a78-4219-8adc-6feee14fa95f None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:07.510317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd293c-3a78-4219-8adc-6feee14fa95f None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:07.510567 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd293c-3a78-4219-8adc-6feee14fa95f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:07.521062 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd293c-3a78-4219-8adc-6feee14fa95f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:07.523118 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd293c-3a78-4219-8adc-6feee14fa95f None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:07.536964 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-c6fd293c-3a78-4219-8adc-6feee14fa95f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:07.536964 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:07.536964 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:07.536964 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:07.536964 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:07.536964 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:07.536964 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:07.536964 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:07.536964 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:07.536964 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:07.536964 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:07.536964 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:07.536964 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:49:07.536964 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:49:07.536964 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:49:07.536964 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:49:07.538676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:07.538676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:07.538676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:07.538676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:07.538676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:07.538676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:07.538676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:07.538676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:07.538676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:07.538676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:07.538676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:07.538676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:07.538676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:07.538676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:07.538676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:07.538676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:07.538676 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:49:07.540007 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:49:07.540007 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:07.540007 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:07.540469 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 414/831] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:49:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:07.544364 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c332efc-334e-4994-998c-9424a7d1cc55 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:07.655663 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:07.660221 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c332efc-334e-4994-998c-9424a7d1cc55 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:07.701458 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f687d8-d2b4-4da0-81ac-5bef5f202300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:07.702099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f687d8-d2b4-4da0-81ac-5bef5f202300 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:07.702500 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f687d8-d2b4-4da0-81ac-5bef5f202300 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:07.702777 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f687d8-d2b4-4da0-81ac-5bef5f202300 None admin] PATH_INFO: `/v3/domains` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:07.703648 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f687d8-d2b4-4da0-81ac-5bef5f202300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:07.704099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f687d8-d2b4-4da0-81ac-5bef5f202300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:07.705664 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f687d8-d2b4-4da0-81ac-5bef5f202300 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:07.724904 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 418/832] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:07.727568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd293c-3a78-4219-8adc-6feee14fa95f None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:07.827601 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:07.831951 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd293c-3a78-4219-8adc-6feee14fa95f None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:07.868963 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d803d4-8283-4013-9ba8-adb09cf86586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:07.869954 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d803d4-8283-4013-9ba8-adb09cf86586 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:07.870304 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d803d4-8283-4013-9ba8-adb09cf86586 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:07.870635 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d803d4-8283-4013-9ba8-adb09cf86586 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:07.878305 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d803d4-8283-4013-9ba8-adb09cf86586 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:07.879715 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d803d4-8283-4013-9ba8-adb09cf86586 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:07.891976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-33d803d4-8283-4013-9ba8-adb09cf86586 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:49:07.891976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:07.891976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:07.891976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:07.891976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:07.891976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:07.891976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:07.891976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:07.891976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:07.891976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:07.891976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:07.891976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:07.891976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:49:07.891976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:49:07.891976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:49:07.891976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:49:07.893153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:07.893153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:07.893153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:49:07.893153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:49:07.893153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:49:07.893153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:49:07.893153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:07.893153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:07.893153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:07.893153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:07.893153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:07.893153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:07.893153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:07.893153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:07.893153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:07.893153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:07.893153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:07.893153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:07.894171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:07.894171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:07.894171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:49:07.894171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:49:07.894171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:49:07.894171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:49:07.894171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:49:07.894171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:49:07.894171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:49:07.894171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:07.894171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 415/833] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:49:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:07.900075 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f687d8-d2b4-4da0-81ac-5bef5f202300 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:08.011622 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f687d8-d2b4-4da0-81ac-5bef5f202300 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:08.049435 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e815ca-3aa8-4b89-bae3-e62431d98ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:08.050097 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e815ca-3aa8-4b89-bae3-e62431d98ef5 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:08.050503 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e815ca-3aa8-4b89-bae3-e62431d98ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:08.050786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e815ca-3aa8-4b89-bae3-e62431d98ef5 None admin] PATH_INFO: `/v3/users` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:08.051624 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e815ca-3aa8-4b89-bae3-e62431d98ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:08.051945 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e815ca-3aa8-4b89-bae3-e62431d98ef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:08.053856 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e815ca-3aa8-4b89-bae3-e62431d98ef5 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:08.081862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 419/834] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Aug 17 14:49:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:08.089551 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d803d4-8283-4013-9ba8-adb09cf86586 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:08.224423 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d803d4-8283-4013-9ba8-adb09cf86586 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:08.274867 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e2f7c-a5b2-4dd8-abf8-7ea1531a7df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:08.275536 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e2f7c-a5b2-4dd8-abf8-7ea1531a7df5 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:08.275819 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e2f7c-a5b2-4dd8-abf8-7ea1531a7df5 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:08.276091 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e2f7c-a5b2-4dd8-abf8-7ea1531a7df5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:08.316067 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:08.366962 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e2f7c-a5b2-4dd8-abf8-7ea1531a7df5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:08.368360 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e2f7c-a5b2-4dd8-abf8-7ea1531a7df5 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:08.489005 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 416/835] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:49:08 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:49:08.495886 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e815ca-3aa8-4b89-bae3-e62431d98ef5 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:08.518178 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:08.630406 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e815ca-3aa8-4b89-bae3-e62431d98ef5 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:08.683093 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94df52f-4bdf-4cf6-ac31-6ed0f610f47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:08.683900 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94df52f-4bdf-4cf6-ac31-6ed0f610f47d None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:08.684248 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94df52f-4bdf-4cf6-ac31-6ed0f610f47d None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:08.684619 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94df52f-4bdf-4cf6-ac31-6ed0f610f47d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:08.697618 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94df52f-4bdf-4cf6-ac31-6ed0f610f47d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:08.700995 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94df52f-4bdf-4cf6-ac31-6ed0f610f47d None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:08.719928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-a94df52f-4bdf-4cf6-ac31-6ed0f610f47d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:08.719928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:08.719928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:08.719928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:08.719928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:08.719928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:08.719928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:08.719928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:08.719928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:08.719928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:08.719928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:08.719928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:08.719928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:49:08.719928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:49:08.719928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:49:08.719928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:49:08.722443 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:08.722443 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:08.722443 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:08.722443 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:08.722443 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:08.722443 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:08.722443 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:08.722443 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:08.722443 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:08.722443 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:08.722443 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:08.722443 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:08.722443 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:08.722443 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:08.722443 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:08.722443 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:08.722443 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:49:08.723397 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:49:08.723397 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:08.723397 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:49:08.724494 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 420/836] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:49:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:08.730617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e2f7c-a5b2-4dd8-abf8-7ea1531a7df5 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:08.808015 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:08.868771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e2f7c-a5b2-4dd8-abf8-7ea1531a7df5 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:08.916303 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a10a5-65e6-4e2f-ad42-f4efc0cc46bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:08.916895 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a10a5-65e6-4e2f-ad42-f4efc0cc46bb None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:08.917319 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a10a5-65e6-4e2f-ad42-f4efc0cc46bb None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:08.917601 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a10a5-65e6-4e2f-ad42-f4efc0cc46bb None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:08.918483 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a10a5-65e6-4e2f-ad42-f4efc0cc46bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:08.918794 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a10a5-65e6-4e2f-ad42-f4efc0cc46bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:08.920182 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a10a5-65e6-4e2f-ad42-f4efc0cc46bb None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:08.935092 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 417/837] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:08.941040 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94df52f-4bdf-4cf6-ac31-6ed0f610f47d None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:09.022326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:09.059858 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94df52f-4bdf-4cf6-ac31-6ed0f610f47d None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:09.104618 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce5685-c35a-4f58-b8be-84ab90f7b3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:09.105453 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce5685-c35a-4f58-b8be-84ab90f7b3df None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:09.105842 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce5685-c35a-4f58-b8be-84ab90f7b3df None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:09.106177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce5685-c35a-4f58-b8be-84ab90f7b3df None admin] PATH_INFO: `/v3/projects/service` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:09.113547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce5685-c35a-4f58-b8be-84ab90f7b3df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:09.115228 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce5685-c35a-4f58-b8be-84ab90f7b3df None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:09.129362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-bcce5685-c35a-4f58-b8be-84ab90f7b3df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:49:09.129362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:09.129362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:09.129362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:09.129362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:09.129362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:09.129362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:09.129362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:09.129362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:09.129362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:09.129362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:09.129362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:09.129362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:49:09.129362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:49:09.129362 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:49:09.130504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:49:09.130504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:09.130504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:09.130504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:09.130504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:09.130504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:09.130504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:09.130504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:09.130504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:09.130504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:09.130504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:09.130504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:09.130504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:09.130504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:09.130504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:09.130504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:09.130504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:09.132461 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:49:09.132461 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:49:09.132461 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:49:09.132461 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:49:09.132461 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:49:09.132461 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:49:09.132461 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:49:09.132461 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:49:09.132461 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 421/838] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:49:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:49:09.137418 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a10a5-65e6-4e2f-ad42-f4efc0cc46bb None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:09.262803 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a10a5-65e6-4e2f-ad42-f4efc0cc46bb None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:09.281503 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:09.301912 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d141e4-38ba-45d8-86f3-df6cdcd97a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:09.302524 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d141e4-38ba-45d8-86f3-df6cdcd97a23 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:09.302901 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d141e4-38ba-45d8-86f3-df6cdcd97a23 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:09.303615 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d141e4-38ba-45d8-86f3-df6cdcd97a23 None admin] PATH_INFO: `/v3/projects` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:09.304317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d141e4-38ba-45d8-86f3-df6cdcd97a23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:09.304628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d141e4-38ba-45d8-86f3-df6cdcd97a23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:09.306088 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d141e4-38ba-45d8-86f3-df6cdcd97a23 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:09.318394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 418/839] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:49:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:09.324776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce5685-c35a-4f58-b8be-84ab90f7b3df None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:09.448295 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce5685-c35a-4f58-b8be-84ab90f7b3df None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:09.477385 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:09.485121 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cffbb9-2e56-4d22-9534-cc241c9146d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:09.485765 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cffbb9-2e56-4d22-9534-cc241c9146d2 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:09.486043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cffbb9-2e56-4d22-9534-cc241c9146d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:09.486317 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cffbb9-2e56-4d22-9534-cc241c9146d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:09.487196 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cffbb9-2e56-4d22-9534-cc241c9146d2 None admin] RBAC: Adding query filter params (role.id=cb99a767f5264f2dace0994d13d0fbc8, scope.project.id=e9d40280440c4d25b6d60a431d6f788b, user.id=ff30f486b0964765bef7665e2b2a9e35) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:09.487673 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cffbb9-2e56-4d22-9534-cc241c9146d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:09.489108 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cffbb9-2e56-4d22-9534-cc241c9146d2 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:09.496019 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 422/840] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:49:09 2022] GET /identity/v3/role_assignments?user.id=ff30f486b0964765bef7665e2b2a9e35&scope.project.id=e9d40280440c4d25b6d60a431d6f788b&role.id=cb99a767f5264f2dace0994d13d0fbc8 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:49:11.739372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2711a4-dc0f-4c41-bef2-8b1651374210 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:11.739910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2711a4-dc0f-4c41-bef2-8b1651374210 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:11.739910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2711a4-dc0f-4c41-bef2-8b1651374210 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:11.741263 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 419/841] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:49:11.746864 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5813ed6-398b-4999-bc4a-c0372e630f36 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:11.747386 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5813ed6-398b-4999-bc4a-c0372e630f36 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:11.747386 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5813ed6-398b-4999-bc4a-c0372e630f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:11.766870 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-f5813ed6-398b-4999-bc4a-c0372e630f36 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:49:11.767979 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-f5813ed6-398b-4999-bc4a-c0372e630f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:49:11.846656 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 423/842] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:49:11 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:49:12.238820 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2711a4-dc0f-4c41-bef2-8b1651374210 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:12.347344 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2711a4-dc0f-4c41-bef2-8b1651374210 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:12.384639 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7e2d1-73ce-4a2f-ba04-bd7fff035fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:12.385262 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7e2d1-73ce-4a2f-ba04-bd7fff035fa1 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:12.385542 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7e2d1-73ce-4a2f-ba04-bd7fff035fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:12.385841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7e2d1-73ce-4a2f-ba04-bd7fff035fa1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:12.396157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7e2d1-73ce-4a2f-ba04-bd7fff035fa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:49:12.401180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-38b7e2d1-73ce-4a2f-ba04-bd7fff035fa1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:49:12.401180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:12.401180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:12.401180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:12.401180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:12.401180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:12.401180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:12.401180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:12.401180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:12.401180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:12.401180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:12.401180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:12.401180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:49:12.401180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:49:12.401180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:49:12.401180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:49:12.402409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:49:12.402409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:49:12.402409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:49:12.402409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:49:12.402409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:12.402409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:12.402409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:12.402409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:12.402409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:12.402409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:12.402409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:12.402409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:12.402409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:12.402409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:12.402409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:12.402409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:12.403344 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:12.403344 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:12.403344 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:12.403344 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:12.403344 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:49:12.403344 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:49:12.403344 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:49:12.403344 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:49:12.403344 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:49:12.403344 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:49:12.403344 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:49:12.403344 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:12.403344 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 420/843] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 17 14:49:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:49:12.409379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5813ed6-398b-4999-bc4a-c0372e630f36 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:12.526063 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5813ed6-398b-4999-bc4a-c0372e630f36 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:12.559013 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:12.572853 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e55afe-23b9-42b6-a3f6-e54defe0f67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:12.573558 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e55afe-23b9-42b6-a3f6-e54defe0f67d None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:12.573943 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e55afe-23b9-42b6-a3f6-e54defe0f67d None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:12.574288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e55afe-23b9-42b6-a3f6-e54defe0f67d None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:12.574960 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e55afe-23b9-42b6-a3f6-e54defe0f67d None admin] RBAC: Adding query filter params (name=service) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:12.575265 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e55afe-23b9-42b6-a3f6-e54defe0f67d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:12.576629 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e55afe-23b9-42b6-a3f6-e54defe0f67d None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:12.586103 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 424/844] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 17 14:49:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:12.591922 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7e2d1-73ce-4a2f-ba04-bd7fff035fa1 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:12.633259 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:12.705281 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7e2d1-73ce-4a2f-ba04-bd7fff035fa1 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:12.743169 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ef321-4980-4a09-98db-ea85b072d003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:12.743865 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ef321-4980-4a09-98db-ea85b072d003 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:12.744096 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ef321-4980-4a09-98db-ea85b072d003 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:12.744359 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ef321-4980-4a09-98db-ea85b072d003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:12.757694 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ef321-4980-4a09-98db-ea85b072d003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:12.759409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ef321-4980-4a09-98db-ea85b072d003 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:12.776228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-f97ef321-4980-4a09-98db-ea85b072d003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:12.776228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:12.776228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:12.776228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:12.776228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:12.776228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:12.776228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:12.776228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:12.776228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:12.776228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:12.776228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:12.776228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:12.776228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:49:12.776228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:49:12.776228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:49:12.776228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:49:12.777394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:12.777394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:12.777394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:12.777394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:12.777394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:12.777394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:12.777394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:12.777394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:12.777394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:12.777394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:12.777394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:12.777394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:12.777394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:12.777394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:12.777394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:12.777394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:12.777394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:49:12.778623 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:49:12.778623 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:12.778623 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:12.778623 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 421/845] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:49:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:12.783211 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e55afe-23b9-42b6-a3f6-e54defe0f67d None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:12.908514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e55afe-23b9-42b6-a3f6-e54defe0f67d None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:12.952159 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73105507-effe-4e83-84f5-7494f6e80a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:12.952936 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73105507-effe-4e83-84f5-7494f6e80a3a None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:12.953397 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73105507-effe-4e83-84f5-7494f6e80a3a None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:12.953704 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73105507-effe-4e83-84f5-7494f6e80a3a None admin] PATH_INFO: `/v3/domains` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:12.954507 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73105507-effe-4e83-84f5-7494f6e80a3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:12.954807 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73105507-effe-4e83-84f5-7494f6e80a3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:12.956178 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73105507-effe-4e83-84f5-7494f6e80a3a None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:12.969083 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 425/846] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:12.976764 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ef321-4980-4a09-98db-ea85b072d003 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:13.080236 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:13.094065 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ef321-4980-4a09-98db-ea85b072d003 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:13.138171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeecd14-ba66-46b9-9625-002d73a5988e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:13.138894 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeecd14-ba66-46b9-9625-002d73a5988e None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:13.139177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeecd14-ba66-46b9-9625-002d73a5988e None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:13.139450 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeecd14-ba66-46b9-9625-002d73a5988e None admin] PATH_INFO: `/v3/users/placement` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:13.147999 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeecd14-ba66-46b9-9625-002d73a5988e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:13.149411 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeecd14-ba66-46b9-9625-002d73a5988e None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:13.160744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-deeecd14-ba66-46b9-9625-002d73a5988e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:49:13.160744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:13.160744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:13.160744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:13.160744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:13.160744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:13.160744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:13.160744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:13.160744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:13.160744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:13.160744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:13.160744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:13.160744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:49:13.160744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:49:13.160744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:49:13.160744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:49:13.161934 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:13.161934 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:13.161934 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:49:13.161934 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:49:13.161934 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:49:13.161934 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:49:13.161934 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:13.161934 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:13.161934 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:13.161934 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:13.161934 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:13.161934 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:13.161934 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:13.161934 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:13.161934 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:13.161934 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:13.161934 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:13.161934 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:13.163875 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:13.163875 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:13.163875 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:49:13.163875 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:49:13.163875 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:49:13.163875 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:49:13.163875 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:49:13.163875 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:49:13.163875 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:49:13.163875 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:13.163875 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 422/847] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:49:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:13.168746 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73105507-effe-4e83-84f5-7494f6e80a3a None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:13.222175 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:13.279689 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73105507-effe-4e83-84f5-7494f6e80a3a None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:13.317388 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d8158-2c93-4d0f-a64e-fbef423289b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:13.318032 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d8158-2c93-4d0f-a64e-fbef423289b4 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:13.318337 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d8158-2c93-4d0f-a64e-fbef423289b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:13.318611 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d8158-2c93-4d0f-a64e-fbef423289b4 None admin] PATH_INFO: `/v3/users` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:13.319339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d8158-2c93-4d0f-a64e-fbef423289b4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:13.319653 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d8158-2c93-4d0f-a64e-fbef423289b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:13.321077 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d8158-2c93-4d0f-a64e-fbef423289b4 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:13.340328 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 426/848] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Aug 17 14:49:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:13.346436 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeecd14-ba66-46b9-9625-002d73a5988e None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:13.459524 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeecd14-ba66-46b9-9625-002d73a5988e None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:13.496744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd78737-2b7a-48c5-9899-df4324c622a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:13.497460 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd78737-2b7a-48c5-9899-df4324c622a6 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:13.497773 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd78737-2b7a-48c5-9899-df4324c622a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:13.498089 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd78737-2b7a-48c5-9899-df4324c622a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:13.509437 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd78737-2b7a-48c5-9899-df4324c622a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:13.511084 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd78737-2b7a-48c5-9899-df4324c622a6 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:13.526771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-dfd78737-2b7a-48c5-9899-df4324c622a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:13.526771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:13.526771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:13.526771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:13.526771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:13.526771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:13.526771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:13.526771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:13.526771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:13.526771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:13.526771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:13.526771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:13.526771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:49:13.526771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:49:13.526771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:49:13.526771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:49:13.527924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:13.527924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:13.527924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:13.527924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:13.527924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:13.527924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:13.527924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:13.527924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:13.527924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:13.527924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:13.527924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:13.527924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:13.527924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:13.527924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:13.527924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:13.527924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:13.527924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:49:13.529076 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:49:13.529076 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:13.529076 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:13.534648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 423/849] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:49:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:49:13.535789 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d8158-2c93-4d0f-a64e-fbef423289b4 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:13.654617 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d8158-2c93-4d0f-a64e-fbef423289b4 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:13.657174 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:13.702698 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ae157-04d3-447e-8f3b-911182f64c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:13.703470 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ae157-04d3-447e-8f3b-911182f64c5a None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:13.703690 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ae157-04d3-447e-8f3b-911182f64c5a None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:13.704006 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ae157-04d3-447e-8f3b-911182f64c5a None admin] PATH_INFO: `/v3/domains` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:13.704655 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ae157-04d3-447e-8f3b-911182f64c5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:13.704955 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ae157-04d3-447e-8f3b-911182f64c5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:13.706455 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ae157-04d3-447e-8f3b-911182f64c5a None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:13.719519 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 427/850] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:49:13.726595 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd78737-2b7a-48c5-9899-df4324c622a6 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:13.730109 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:13.839529 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd78737-2b7a-48c5-9899-df4324c622a6 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:13.877510 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29b64a-fab3-40b6-8688-ddb3f6e36518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:13.878253 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29b64a-fab3-40b6-8688-ddb3f6e36518 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:13.878505 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29b64a-fab3-40b6-8688-ddb3f6e36518 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:13.878816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29b64a-fab3-40b6-8688-ddb3f6e36518 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:13.886368 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29b64a-fab3-40b6-8688-ddb3f6e36518 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:13.887923 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29b64a-fab3-40b6-8688-ddb3f6e36518 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:13.899398 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-5e29b64a-fab3-40b6-8688-ddb3f6e36518 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:49:13.899398 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:13.899398 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:13.899398 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:13.899398 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:13.899398 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:13.899398 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:13.899398 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:13.899398 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:13.899398 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:13.899398 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:13.899398 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:13.899398 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:49:13.899398 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:49:13.899398 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:49:13.900646 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:49:13.900646 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:13.900646 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:13.900646 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:13.900646 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:13.900646 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:13.900646 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:13.900646 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:13.900646 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:13.900646 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:13.900646 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:13.900646 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:13.900646 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:13.900646 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:13.900646 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:13.900646 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:13.900646 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:13.901655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:49:13.901655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:49:13.901655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:49:13.901655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:49:13.901655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:49:13.901655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:49:13.901655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:49:13.901655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:13.901655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 424/851] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:49:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:13.907204 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ae157-04d3-447e-8f3b-911182f64c5a None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:14.014513 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ae157-04d3-447e-8f3b-911182f64c5a None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:14.051431 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9e599-7364-444c-b9a1-d046780f5bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:14.052058 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9e599-7364-444c-b9a1-d046780f5bc2 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:14.052373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9e599-7364-444c-b9a1-d046780f5bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:14.052665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9e599-7364-444c-b9a1-d046780f5bc2 None admin] PATH_INFO: `/v3/projects` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:14.054228 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9e599-7364-444c-b9a1-d046780f5bc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:14.054545 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9e599-7364-444c-b9a1-d046780f5bc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:14.056030 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9e599-7364-444c-b9a1-d046780f5bc2 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:14.071069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 428/852] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:49:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:49:14.077579 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29b64a-fab3-40b6-8688-ddb3f6e36518 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:14.144649 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:14.201769 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29b64a-fab3-40b6-8688-ddb3f6e36518 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:14.239459 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f7b19-1cd4-47b0-80ff-985789c99edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:14.240203 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f7b19-1cd4-47b0-80ff-985789c99edf None admin] REQUEST_METHOD: `PUT` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:14.240518 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f7b19-1cd4-47b0-80ff-985789c99edf None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:14.240945 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f7b19-1cd4-47b0-80ff-985789c99edf None admin] PATH_INFO: `/v3/projects/e9d40280440c4d25b6d60a431d6f788b/users/ff30f486b0964765bef7665e2b2a9e35/roles/cb99a767f5264f2dace0994d13d0fbc8` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:14.257353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f7b19-1cd4-47b0-80ff-985789c99edf None admin] RBAC: Authorizing `identity:create_grant(project_id=e9d40280440c4d25b6d60a431d6f788b, user_id=ff30f486b0964765bef7665e2b2a9e35, role_id=cb99a767f5264f2dace0994d13d0fbc8)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:14.258825 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f7b19-1cd4-47b0-80ff-985789c99edf None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:14.273150 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 425/853] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 17 14:49:14 2022] PUT /identity/v3/projects/e9d40280440c4d25b6d60a431d6f788b/users/ff30f486b0964765bef7665e2b2a9e35/roles/cb99a767f5264f2dace0994d13d0fbc8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:49:16.485938 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06ed6b-ee01-4afe-8f2a-cea1381a5394 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:16.487012 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06ed6b-ee01-4afe-8f2a-cea1381a5394 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:16.487012 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06ed6b-ee01-4afe-8f2a-cea1381a5394 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:16.487805 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 429/854] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:49:16.495072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d8861-fbf0-4884-8d97-49dada7c9a9d None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:16.495607 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d8861-fbf0-4884-8d97-49dada7c9a9d None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:16.496078 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d8861-fbf0-4884-8d97-49dada7c9a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:16.519714 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-7f5d8861-fbf0-4884-8d97-49dada7c9a9d None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:49:16.521782 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-7f5d8861-fbf0-4884-8d97-49dada7c9a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:49:16.601904 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 426/855] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:49:16 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:49:17.010805 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06ed6b-ee01-4afe-8f2a-cea1381a5394 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:17.040369 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:17.143503 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06ed6b-ee01-4afe-8f2a-cea1381a5394 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:17.181012 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba835e6a-9331-48b0-9150-62edf9c7696b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:17.182065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba835e6a-9331-48b0-9150-62edf9c7696b None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:17.182543 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba835e6a-9331-48b0-9150-62edf9c7696b None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:17.183091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba835e6a-9331-48b0-9150-62edf9c7696b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:17.196541 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba835e6a-9331-48b0-9150-62edf9c7696b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:49:17.202531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-ba835e6a-9331-48b0-9150-62edf9c7696b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:49:17.202531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:17.202531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:17.202531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:17.202531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:17.202531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:17.202531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:17.202531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:17.202531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:17.202531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:17.202531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:17.202531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:17.202531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:49:17.202531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:49:17.202531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:49:17.202531 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:49:17.204415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:49:17.204415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:49:17.204415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:49:17.204415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:49:17.204415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:17.204415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:17.204415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:17.204415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:17.204415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:17.204415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:17.204415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:17.204415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:17.204415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:17.204415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:17.204415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:17.204415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:17.206231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:17.206231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:17.206231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:17.206231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:17.206231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:49:17.206231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:49:17.206231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:49:17.206231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:49:17.206231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:49:17.206231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:49:17.206231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:49:17.206231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:49:17.206231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 430/856] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Aug 17 14:49:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:17.209915 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d8861-fbf0-4884-8d97-49dada7c9a9d None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:17.257509 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:17.319444 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d8861-fbf0-4884-8d97-49dada7c9a9d None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:17.358116 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c5a0d-a95c-42b8-a819-ad491b0e1ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:17.358722 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c5a0d-a95c-42b8-a819-ad491b0e1ccf None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:17.359002 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c5a0d-a95c-42b8-a819-ad491b0e1ccf None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:17.359343 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c5a0d-a95c-42b8-a819-ad491b0e1ccf None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:17.360126 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c5a0d-a95c-42b8-a819-ad491b0e1ccf None admin] RBAC: Adding query filter params (name=service) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:17.360467 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c5a0d-a95c-42b8-a819-ad491b0e1ccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:17.362026 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c5a0d-a95c-42b8-a819-ad491b0e1ccf None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:17.372654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 427/857] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Aug 17 14:49:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:17.378826 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba835e6a-9331-48b0-9150-62edf9c7696b None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:17.473087 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:17.494050 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba835e6a-9331-48b0-9150-62edf9c7696b None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:17.531299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec9eb1-5938-4b3e-9e93-f3dc92d83b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:17.531922 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec9eb1-5938-4b3e-9e93-f3dc92d83b3f None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:17.532206 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec9eb1-5938-4b3e-9e93-f3dc92d83b3f None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:17.532480 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec9eb1-5938-4b3e-9e93-f3dc92d83b3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:17.543737 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec9eb1-5938-4b3e-9e93-f3dc92d83b3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:17.545266 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec9eb1-5938-4b3e-9e93-f3dc92d83b3f None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:17.561175 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-d5ec9eb1-5938-4b3e-9e93-f3dc92d83b3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:17.561175 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:17.561175 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:17.561175 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:17.561175 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:17.561175 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:17.561175 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:17.561175 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:17.561175 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:17.561175 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:17.561175 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:17.561175 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:17.561175 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:49:17.561175 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:49:17.561175 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:49:17.561175 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:49:17.562341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:17.562341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:17.562341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:17.562341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:17.562341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:17.562341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:17.562341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:17.562341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:17.562341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:17.562341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:17.562341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:17.562341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:17.562341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:17.562341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:17.562341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:17.562341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:17.562341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:49:17.563230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:49:17.563230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:17.563230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:49:17.563230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 431/858] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:49:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:17.568038 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c5a0d-a95c-42b8-a819-ad491b0e1ccf None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:17.682251 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c5a0d-a95c-42b8-a819-ad491b0e1ccf None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:17.684541 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:17.720997 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ceae03-a9a6-40f4-9ec7-f07664005a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:17.721604 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ceae03-a9a6-40f4-9ec7-f07664005a71 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:17.721922 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ceae03-a9a6-40f4-9ec7-f07664005a71 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:17.722197 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ceae03-a9a6-40f4-9ec7-f07664005a71 None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:17.722869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ceae03-a9a6-40f4-9ec7-f07664005a71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:17.723172 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ceae03-a9a6-40f4-9ec7-f07664005a71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:17.725277 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ceae03-a9a6-40f4-9ec7-f07664005a71 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:17.741591 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 428/859] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:17.747767 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec9eb1-5938-4b3e-9e93-f3dc92d83b3f None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:17.861919 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec9eb1-5938-4b3e-9e93-f3dc92d83b3f None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:17.902913 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fae87-4854-4001-b9db-9fd9fd0e24bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:17.903804 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fae87-4854-4001-b9db-9fd9fd0e24bb None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:17.904138 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fae87-4854-4001-b9db-9fd9fd0e24bb None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:17.904456 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fae87-4854-4001-b9db-9fd9fd0e24bb None admin] PATH_INFO: `/v3/users/placement` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:17.907928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:17.914816 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fae87-4854-4001-b9db-9fd9fd0e24bb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:17.916432 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fae87-4854-4001-b9db-9fd9fd0e24bb None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:17.927310 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-999fae87-4854-4001-b9db-9fd9fd0e24bb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:49:17.927310 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:17.927310 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:17.927310 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:17.927310 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:17.927310 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:17.927310 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:17.927310 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:17.927310 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:17.927310 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:17.927310 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:17.927310 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:17.927310 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:49:17.927310 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:49:17.927310 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:49:17.927310 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:49:17.928305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:17.928305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:17.928305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:49:17.928305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:49:17.928305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:49:17.928305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:49:17.928305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:17.928305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:17.928305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:17.928305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:17.928305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:17.928305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:17.928305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:17.928305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:17.928305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:17.928305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:17.928305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:17.928305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:17.929291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:17.929291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:17.929291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:49:17.929291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:49:17.929291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:49:17.929291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:49:17.929291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:49:17.929291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:49:17.929291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:49:17.929291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:49:17.929291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 432/860] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:49:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:17.935263 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ceae03-a9a6-40f4-9ec7-f07664005a71 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:18.049837 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ceae03-a9a6-40f4-9ec7-f07664005a71 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:18.097865 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbf152-d0a0-4a76-8424-b829c77cb734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:18.098485 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbf152-d0a0-4a76-8424-b829c77cb734 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:18.099033 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbf152-d0a0-4a76-8424-b829c77cb734 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:18.099309 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbf152-d0a0-4a76-8424-b829c77cb734 None admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:18.101110 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbf152-d0a0-4a76-8424-b829c77cb734 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:18.101409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbf152-d0a0-4a76-8424-b829c77cb734 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:18.103046 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbf152-d0a0-4a76-8424-b829c77cb734 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:18.123411 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 429/861] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Aug 17 14:49:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:49:18.129978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fae87-4854-4001-b9db-9fd9fd0e24bb None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:18.254057 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fae87-4854-4001-b9db-9fd9fd0e24bb None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:18.292962 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2205a6-a8de-4512-90cc-b2b7b3c976c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:18.293573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2205a6-a8de-4512-90cc-b2b7b3c976c8 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:18.293892 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2205a6-a8de-4512-90cc-b2b7b3c976c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:18.294170 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2205a6-a8de-4512-90cc-b2b7b3c976c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:18.363507 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:18.372127 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2205a6-a8de-4512-90cc-b2b7b3c976c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:18.373573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2205a6-a8de-4512-90cc-b2b7b3c976c8 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:18.488849 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 433/862] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:49:18 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 14:49:18.495461 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbf152-d0a0-4a76-8424-b829c77cb734 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:18.524647 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:18.610811 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbf152-d0a0-4a76-8424-b829c77cb734 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:18.647967 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010af77-4f7f-478c-ba32-52e1781331ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:18.648718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010af77-4f7f-478c-ba32-52e1781331ca None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:18.649068 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010af77-4f7f-478c-ba32-52e1781331ca None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:18.649416 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010af77-4f7f-478c-ba32-52e1781331ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:18.661180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010af77-4f7f-478c-ba32-52e1781331ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:18.664158 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010af77-4f7f-478c-ba32-52e1781331ca None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:18.679354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-b010af77-4f7f-478c-ba32-52e1781331ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:18.679354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:18.679354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:18.679354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:18.679354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:18.679354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:18.679354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:18.679354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:18.679354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:18.679354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:18.679354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:18.679354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:18.679354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:49:18.679354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:49:18.679354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:49:18.679354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:49:18.680349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:18.680349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:18.680349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:18.680349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:18.680349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:18.680349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:18.680349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:18.680349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:18.680349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:18.680349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:18.680349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:18.680349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:18.680349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:18.680349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:18.680349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:18.680349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:18.680349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:49:18.681581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:49:18.681581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:18.681581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:18.681581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 430/863] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:49:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:18.686226 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2205a6-a8de-4512-90cc-b2b7b3c976c8 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:18.790415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:18.797062 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2205a6-a8de-4512-90cc-b2b7b3c976c8 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:18.835281 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625bd10-6e04-4815-8cbf-dfb6cb9f675c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:18.835910 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625bd10-6e04-4815-8cbf-dfb6cb9f675c None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:18.836182 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625bd10-6e04-4815-8cbf-dfb6cb9f675c None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:18.836434 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625bd10-6e04-4815-8cbf-dfb6cb9f675c None admin] PATH_INFO: `/v3/domains` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:18.837080 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625bd10-6e04-4815-8cbf-dfb6cb9f675c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:18.837411 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625bd10-6e04-4815-8cbf-dfb6cb9f675c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:18.838858 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625bd10-6e04-4815-8cbf-dfb6cb9f675c None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:18.852095 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 434/864] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:18.858433 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010af77-4f7f-478c-ba32-52e1781331ca None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:18.949824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:18.978675 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010af77-4f7f-478c-ba32-52e1781331ca None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:19.019994 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df239cca-2957-474e-ace5-8c65d46fd01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:19.020700 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df239cca-2957-474e-ace5-8c65d46fd01c None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:19.020981 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df239cca-2957-474e-ace5-8c65d46fd01c None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:19.021877 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df239cca-2957-474e-ace5-8c65d46fd01c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:19.031035 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df239cca-2957-474e-ace5-8c65d46fd01c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:19.032627 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df239cca-2957-474e-ace5-8c65d46fd01c None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:19.045302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-df239cca-2957-474e-ace5-8c65d46fd01c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:49:19.045302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:19.045302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:19.045302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:19.045302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:19.045302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:19.045302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:19.045302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:19.045302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:19.045302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:19.045302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:19.045302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:19.045302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:49:19.045302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:49:19.045302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:49:19.046283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:49:19.046283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:19.046283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:19.046283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:19.046283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:19.046283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:19.046283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:19.046283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:19.046283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:19.046283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:19.046283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:19.046283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:19.046283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:19.046283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:19.046283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:19.046283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:19.046283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:19.047250 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:49:19.047250 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:49:19.047250 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:49:19.047250 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:49:19.047250 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:49:19.047250 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:49:19.047250 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:49:19.047250 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:19.047250 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 431/865] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:49:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:19.053374 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625bd10-6e04-4815-8cbf-dfb6cb9f675c None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:19.175703 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625bd10-6e04-4815-8cbf-dfb6cb9f675c None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:19.218105 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37b396-e3ef-4137-aa22-6accfa9323b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:19.218848 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37b396-e3ef-4137-aa22-6accfa9323b5 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:19.219152 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37b396-e3ef-4137-aa22-6accfa9323b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:19.219526 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37b396-e3ef-4137-aa22-6accfa9323b5 None admin] PATH_INFO: `/v3/projects` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:19.220382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37b396-e3ef-4137-aa22-6accfa9323b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:19.220719 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37b396-e3ef-4137-aa22-6accfa9323b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:19.222473 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37b396-e3ef-4137-aa22-6accfa9323b5 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:19.237322 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 435/866] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:49:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:19.245082 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df239cca-2957-474e-ace5-8c65d46fd01c None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:19.368091 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df239cca-2957-474e-ace5-8c65d46fd01c None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:19.406488 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21acc782-e3b2-42ec-9ec3-93207671b9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:19.407123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acc782-e3b2-42ec-9ec3-93207671b9cc None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:19.407428 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acc782-e3b2-42ec-9ec3-93207671b9cc None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:19.407738 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acc782-e3b2-42ec-9ec3-93207671b9cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:19.408602 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21acc782-e3b2-42ec-9ec3-93207671b9cc None admin] RBAC: Adding query filter params (role.id=cb99a767f5264f2dace0994d13d0fbc8, scope.project.id=e9d40280440c4d25b6d60a431d6f788b, user.id=ff30f486b0964765bef7665e2b2a9e35) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:19.409070 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21acc782-e3b2-42ec-9ec3-93207671b9cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:19.410741 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21acc782-e3b2-42ec-9ec3-93207671b9cc None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:19.412907 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:19.429046 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 432/867] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:49:19 2022] GET /identity/v3/role_assignments?user.id=ff30f486b0964765bef7665e2b2a9e35&scope.project.id=e9d40280440c4d25b6d60a431d6f788b&role.id=cb99a767f5264f2dace0994d13d0fbc8 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:49:21.941754 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3b77e-11ab-4805-b1a5-61a132225b98 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:21.942245 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3b77e-11ab-4805-b1a5-61a132225b98 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:21.942245 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3b77e-11ab-4805-b1a5-61a132225b98 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:21.943996 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 436/868] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:49:21.949658 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280b4f5-c97f-4f75-b967-7ade629c894c None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:21.950179 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280b4f5-c97f-4f75-b967-7ade629c894c None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:21.950284 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280b4f5-c97f-4f75-b967-7ade629c894c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:21.969317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-8280b4f5-c97f-4f75-b967-7ade629c894c None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:49:21.971032 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-8280b4f5-c97f-4f75-b967-7ade629c894c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:49:22.044623 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 433/869] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:49:21 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:49:22.416061 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3b77e-11ab-4805-b1a5-61a132225b98 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:22.437410 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:22.532001 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3b77e-11ab-4805-b1a5-61a132225b98 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:22.570115 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640476b-c7e3-4f0f-b447-9bf247722680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:22.570760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640476b-c7e3-4f0f-b447-9bf247722680 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:22.571035 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640476b-c7e3-4f0f-b447-9bf247722680 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:22.571302 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640476b-c7e3-4f0f-b447-9bf247722680 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:22.583162 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640476b-c7e3-4f0f-b447-9bf247722680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:49:22.588256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-8640476b-c7e3-4f0f-b447-9bf247722680 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:49:22.588256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:22.588256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:22.588256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:22.588256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:22.588256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:22.588256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:22.588256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:22.588256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:22.588256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:22.588256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:22.588256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:22.588256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:49:22.588256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:49:22.588256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:49:22.588256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:49:22.589326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:49:22.589326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:49:22.589326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:49:22.589326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:49:22.589326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:22.589326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:22.589326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:22.589326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:22.589326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:22.589326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:22.589326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:22.589326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:22.589326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:22.589326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:22.589326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:22.589326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:22.590379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:22.590379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:22.590379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:22.590379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:22.590379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:49:22.590379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:49:22.590379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:49:22.590379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:49:22.590379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:49:22.590379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:49:22.590379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:49:22.590379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:49:22.590379 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 437/870] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 17 14:49:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:22.595617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280b4f5-c97f-4f75-b967-7ade629c894c None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:22.703813 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280b4f5-c97f-4f75-b967-7ade629c894c None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:22.732706 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:22.742478 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1cb5e-7c34-458a-96ef-caa6cddf68f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:22.743099 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1cb5e-7c34-458a-96ef-caa6cddf68f6 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:22.743377 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1cb5e-7c34-458a-96ef-caa6cddf68f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:22.743647 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1cb5e-7c34-458a-96ef-caa6cddf68f6 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:22.744329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1cb5e-7c34-458a-96ef-caa6cddf68f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:22.744900 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1cb5e-7c34-458a-96ef-caa6cddf68f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:22.746325 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1cb5e-7c34-458a-96ef-caa6cddf68f6 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:22.755328 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 434/871] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:49:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:22.762284 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640476b-c7e3-4f0f-b447-9bf247722680 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:22.844885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:22.870467 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640476b-c7e3-4f0f-b447-9bf247722680 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:22.905104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011487f-deb6-4ed2-b468-8042a63cbfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:22.905790 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011487f-deb6-4ed2-b468-8042a63cbfd0 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:22.906026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011487f-deb6-4ed2-b468-8042a63cbfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:22.906297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011487f-deb6-4ed2-b468-8042a63cbfd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:22.916717 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011487f-deb6-4ed2-b468-8042a63cbfd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:22.918195 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011487f-deb6-4ed2-b468-8042a63cbfd0 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:22.933770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-8011487f-deb6-4ed2-b468-8042a63cbfd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:22.933770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:22.933770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:22.933770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:22.933770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:22.933770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:22.933770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:22.933770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:22.933770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:22.933770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:22.933770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:22.933770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:22.933770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:49:22.933770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:49:22.933770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:49:22.933770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:49:22.934917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:22.934917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:22.934917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:22.934917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:22.934917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:22.934917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:22.934917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:22.934917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:22.934917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:22.934917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:22.934917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:22.934917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:22.934917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:22.934917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:22.934917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:22.934917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:22.934917 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:49:22.936183 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:49:22.936183 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:22.936183 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:49:22.936183 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 438/872] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:49:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:22.940653 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1cb5e-7c34-458a-96ef-caa6cddf68f6 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:23.049369 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1cb5e-7c34-458a-96ef-caa6cddf68f6 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:23.091402 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa4d6d-f374-4c92-86e6-c58bcf82055e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:23.092258 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa4d6d-f374-4c92-86e6-c58bcf82055e None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:23.092533 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa4d6d-f374-4c92-86e6-c58bcf82055e None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:23.092872 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa4d6d-f374-4c92-86e6-c58bcf82055e None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:23.093449 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa4d6d-f374-4c92-86e6-c58bcf82055e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:23.093758 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa4d6d-f374-4c92-86e6-c58bcf82055e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:23.095157 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa4d6d-f374-4c92-86e6-c58bcf82055e None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:23.110735 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 435/873] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:23.116460 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011487f-deb6-4ed2-b468-8042a63cbfd0 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:23.219583 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011487f-deb6-4ed2-b468-8042a63cbfd0 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:23.249657 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:23.259356 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ae223-1eae-428d-a9b9-9cb4239a7756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:23.259974 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ae223-1eae-428d-a9b9-9cb4239a7756 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:23.260253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ae223-1eae-428d-a9b9-9cb4239a7756 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:23.260523 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ae223-1eae-428d-a9b9-9cb4239a7756 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:23.267868 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ae223-1eae-428d-a9b9-9cb4239a7756 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:23.269287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ae223-1eae-428d-a9b9-9cb4239a7756 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:23.280098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-7b4ae223-1eae-428d-a9b9-9cb4239a7756 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:49:23.280098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:23.280098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:23.280098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:23.280098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:23.280098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:23.280098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:23.280098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:23.280098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:23.280098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:23.280098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:23.280098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:23.280098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:49:23.280098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:49:23.280098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:49:23.280098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:49:23.281346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:23.281346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:23.281346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:49:23.281346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:49:23.281346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:49:23.281346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:49:23.281346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:23.281346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:23.281346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:23.281346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:23.281346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:23.281346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:23.281346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:23.281346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:23.281346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:23.281346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:23.281346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:23.281346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:23.282489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:23.282489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:23.282489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:49:23.282489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:49:23.282489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:49:23.282489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:49:23.282489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:49:23.282489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:49:23.282489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:49:23.282489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:49:23.282489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 439/874] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:49:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:23.287032 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa4d6d-f374-4c92-86e6-c58bcf82055e None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:23.335787 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:23.384924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa4d6d-f374-4c92-86e6-c58bcf82055e None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:23.417474 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f87def-f3c1-45e5-9789-50773c5ff07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:23.418103 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f87def-f3c1-45e5-9789-50773c5ff07e None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:23.418379 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f87def-f3c1-45e5-9789-50773c5ff07e None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:23.418647 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f87def-f3c1-45e5-9789-50773c5ff07e None admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:23.419368 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f87def-f3c1-45e5-9789-50773c5ff07e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:23.419670 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f87def-f3c1-45e5-9789-50773c5ff07e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:23.421076 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f87def-f3c1-45e5-9789-50773c5ff07e None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:23.438278 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 436/875] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Aug 17 14:49:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:23.444642 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ae223-1eae-428d-a9b9-9cb4239a7756 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:23.542345 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ae223-1eae-428d-a9b9-9cb4239a7756 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:23.575586 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc70c9e-ed18-4396-902b-7d2a3e2f665d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:23.576172 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc70c9e-ed18-4396-902b-7d2a3e2f665d None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:23.576446 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc70c9e-ed18-4396-902b-7d2a3e2f665d None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:23.576713 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc70c9e-ed18-4396-902b-7d2a3e2f665d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:23.631892 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:23.644015 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc70c9e-ed18-4396-902b-7d2a3e2f665d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:23.645476 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc70c9e-ed18-4396-902b-7d2a3e2f665d None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:23.741510 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 440/876] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:49:23 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:49:23.747498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f87def-f3c1-45e5-9789-50773c5ff07e None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:23.845706 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f87def-f3c1-45e5-9789-50773c5ff07e None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:23.855331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:23.879621 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b90c1-577e-421f-b7da-b7ec69b9ee84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:23.880233 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b90c1-577e-421f-b7da-b7ec69b9ee84 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:23.880575 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b90c1-577e-421f-b7da-b7ec69b9ee84 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:23.880842 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b90c1-577e-421f-b7da-b7ec69b9ee84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:23.890591 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b90c1-577e-421f-b7da-b7ec69b9ee84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:23.891967 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b90c1-577e-421f-b7da-b7ec69b9ee84 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:23.906414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-554b90c1-577e-421f-b7da-b7ec69b9ee84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:23.906414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:23.906414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:23.906414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:23.906414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:23.906414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:23.906414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:23.906414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:23.906414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:23.906414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:23.906414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:23.906414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:23.906414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:49:23.906414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:49:23.906414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:49:23.906414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:49:23.907329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:23.907329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:23.907329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:23.907329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:23.907329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:23.907329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:23.907329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:23.907329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:23.907329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:23.907329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:23.907329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:23.907329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:23.907329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:23.907329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:23.907329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:23.907329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:23.907329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:49:23.908264 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:49:23.908264 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:23.908264 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:23.908264 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 437/877] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:49:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:23.913763 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc70c9e-ed18-4396-902b-7d2a3e2f665d None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:23.999277 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:24.011677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc70c9e-ed18-4396-902b-7d2a3e2f665d None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:24.045415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1629d8-9532-4469-8c07-f0192ee33184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:24.046026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1629d8-9532-4469-8c07-f0192ee33184 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:24.046299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1629d8-9532-4469-8c07-f0192ee33184 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:24.046562 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1629d8-9532-4469-8c07-f0192ee33184 None admin] PATH_INFO: `/v3/domains` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:24.047188 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1629d8-9532-4469-8c07-f0192ee33184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:24.047571 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1629d8-9532-4469-8c07-f0192ee33184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:24.048828 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1629d8-9532-4469-8c07-f0192ee33184 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:24.061112 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 441/878] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:24.066571 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b90c1-577e-421f-b7da-b7ec69b9ee84 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:24.169388 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b90c1-577e-421f-b7da-b7ec69b9ee84 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:24.201103 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bf2b9-41aa-4315-b228-76130f170266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:24.201714 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bf2b9-41aa-4315-b228-76130f170266 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:24.202020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bf2b9-41aa-4315-b228-76130f170266 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:24.202291 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bf2b9-41aa-4315-b228-76130f170266 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:24.209278 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bf2b9-41aa-4315-b228-76130f170266 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:24.210865 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bf2b9-41aa-4315-b228-76130f170266 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:24.221583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-498bf2b9-41aa-4315-b228-76130f170266 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:49:24.221583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:24.221583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:24.221583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:24.221583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:24.221583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:24.221583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:24.221583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:24.221583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:24.221583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:24.221583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:24.221583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:24.221583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:49:24.221583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:49:24.221583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:49:24.222648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:49:24.222648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:24.222648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:24.222648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:24.222648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:24.222648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:24.222648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:24.222648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:24.222648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:24.222648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:24.222648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:24.222648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:24.222648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:24.222648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:24.222648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:24.222648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:24.222648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:24.223543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:49:24.223543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:49:24.223543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:49:24.223543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:49:24.223543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:49:24.223543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:49:24.223543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:49:24.223543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:24.223543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 438/879] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:49:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:24.229232 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1629d8-9532-4469-8c07-f0192ee33184 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:24.331080 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1629d8-9532-4469-8c07-f0192ee33184 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:24.363641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0dc54-078a-40c4-97c5-3066544061e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:24.364229 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0dc54-078a-40c4-97c5-3066544061e9 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:24.364504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0dc54-078a-40c4-97c5-3066544061e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:24.364802 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0dc54-078a-40c4-97c5-3066544061e9 None admin] PATH_INFO: `/v3/projects` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:24.365476 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0dc54-078a-40c4-97c5-3066544061e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:24.365796 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0dc54-078a-40c4-97c5-3066544061e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:24.367215 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0dc54-078a-40c4-97c5-3066544061e9 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:24.378875 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 442/880] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:49:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:24.385462 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bf2b9-41aa-4315-b228-76130f170266 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:24.408400 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:24.485022 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bf2b9-41aa-4315-b228-76130f170266 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:24.517900 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c200247-7fa1-4141-87b7-1191f601cb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:24.518485 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c200247-7fa1-4141-87b7-1191f601cb84 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:24.518759 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c200247-7fa1-4141-87b7-1191f601cb84 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:24.519026 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c200247-7fa1-4141-87b7-1191f601cb84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:24.519730 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c200247-7fa1-4141-87b7-1191f601cb84 None admin] RBAC: Adding query filter params (role.id=a307f157f2a445c7af8bd4fd41aa1c4b, scope.project.id=e9d40280440c4d25b6d60a431d6f788b, user.id=ff30f486b0964765bef7665e2b2a9e35) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:24.520030 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c200247-7fa1-4141-87b7-1191f601cb84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:24.522260 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c200247-7fa1-4141-87b7-1191f601cb84 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:24.527368 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 439/881] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:49:24 2022] GET /identity/v3/role_assignments?user.id=ff30f486b0964765bef7665e2b2a9e35&scope.project.id=e9d40280440c4d25b6d60a431d6f788b&role.id=a307f157f2a445c7af8bd4fd41aa1c4b => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:26.711578 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2e350-d78b-4a62-8d48-8c410a442e90 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:26.712112 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2e350-d78b-4a62-8d48-8c410a442e90 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:26.712112 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2e350-d78b-4a62-8d48-8c410a442e90 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:26.713435 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 443/882] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:49:26.718624 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd358328-e495-46af-8837-57e0585303cb None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:26.719043 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd358328-e495-46af-8837-57e0585303cb None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:26.719167 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd358328-e495-46af-8837-57e0585303cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:26.736871 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-cd358328-e495-46af-8837-57e0585303cb None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:49:26.738095 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-cd358328-e495-46af-8837-57e0585303cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:49:26.804007 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 440/883] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:49:26 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:49:27.130662 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2e350-d78b-4a62-8d48-8c410a442e90 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:27.141464 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:27.232397 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2e350-d78b-4a62-8d48-8c410a442e90 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:27.269110 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a997c-e9a9-4316-8dea-0e0db8bf7907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:27.269719 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a997c-e9a9-4316-8dea-0e0db8bf7907 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:27.270026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a997c-e9a9-4316-8dea-0e0db8bf7907 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:27.270296 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a997c-e9a9-4316-8dea-0e0db8bf7907 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:27.286764 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a997c-e9a9-4316-8dea-0e0db8bf7907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:49:27.295862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-575a997c-e9a9-4316-8dea-0e0db8bf7907 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:49:27.295862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:27.295862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:27.295862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:27.295862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:27.295862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:27.295862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:27.295862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:27.295862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:27.295862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:27.295862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:27.295862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:27.295862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:49:27.295862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:49:27.295862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:49:27.295862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:49:27.297214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:49:27.297214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:49:27.297214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:49:27.297214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:49:27.297214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:27.297214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:27.297214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:27.297214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:27.297214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:27.297214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:27.297214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:27.297214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:27.297214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:27.297214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:27.297214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:27.297214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:27.298173 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:27.298173 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:27.298173 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:27.298173 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:27.298173 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:49:27.298173 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:49:27.298173 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:49:27.298173 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:49:27.298173 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:49:27.298173 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:49:27.298173 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:49:27.298173 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:49:27.298173 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 444/884] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 17 14:49:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:27.304796 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd358328-e495-46af-8837-57e0585303cb None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:27.320043 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:27.402412 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd358328-e495-46af-8837-57e0585303cb None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:27.434362 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999a280-1b6e-4e4d-a4d2-6e37d2f065c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:27.434949 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999a280-1b6e-4e4d-a4d2-6e37d2f065c8 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:27.435224 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999a280-1b6e-4e4d-a4d2-6e37d2f065c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:27.435493 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999a280-1b6e-4e4d-a4d2-6e37d2f065c8 None admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:27.436146 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999a280-1b6e-4e4d-a4d2-6e37d2f065c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:27.436443 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999a280-1b6e-4e4d-a4d2-6e37d2f065c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:27.437855 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999a280-1b6e-4e4d-a4d2-6e37d2f065c8 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:27.446251 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 441/885] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:49:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:27.452070 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a997c-e9a9-4316-8dea-0e0db8bf7907 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:27.518835 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:27.552421 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a997c-e9a9-4316-8dea-0e0db8bf7907 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:27.588104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0766aba-b0d9-47ed-8e52-16c560f7105a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:27.588715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0766aba-b0d9-47ed-8e52-16c560f7105a None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:27.588993 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0766aba-b0d9-47ed-8e52-16c560f7105a None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:27.589267 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0766aba-b0d9-47ed-8e52-16c560f7105a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:27.599068 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0766aba-b0d9-47ed-8e52-16c560f7105a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:27.600558 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0766aba-b0d9-47ed-8e52-16c560f7105a None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:27.615339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-a0766aba-b0d9-47ed-8e52-16c560f7105a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:27.615339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:27.615339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:27.615339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:27.615339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:27.615339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:27.615339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:27.615339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:27.615339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:27.615339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:27.615339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:27.615339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:27.615339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:49:27.615339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:49:27.615339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:49:27.615339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:49:27.616351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:27.616351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:27.616351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:27.616351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:27.616351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:27.616351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:27.616351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:27.616351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:27.616351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:27.616351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:27.616351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:27.616351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:27.616351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:27.616351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:27.616351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:27.616351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:27.616351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:49:27.621796 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:49:27.621796 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:27.621796 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:49:27.621796 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 445/886] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:49:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:27.623391 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999a280-1b6e-4e4d-a4d2-6e37d2f065c8 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:27.701662 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:27.723568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999a280-1b6e-4e4d-a4d2-6e37d2f065c8 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:27.756377 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726efdfa-b5ab-4dc2-9827-982b2b750acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:27.756993 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726efdfa-b5ab-4dc2-9827-982b2b750acc None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:27.757272 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726efdfa-b5ab-4dc2-9827-982b2b750acc None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:27.757568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726efdfa-b5ab-4dc2-9827-982b2b750acc None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:27.758267 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726efdfa-b5ab-4dc2-9827-982b2b750acc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:27.758571 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726efdfa-b5ab-4dc2-9827-982b2b750acc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:27.759921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726efdfa-b5ab-4dc2-9827-982b2b750acc None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:27.771639 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 442/887] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:27.777524 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0766aba-b0d9-47ed-8e52-16c560f7105a None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:27.876281 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0766aba-b0d9-47ed-8e52-16c560f7105a None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:27.895963 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:27.910219 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac33999-55d3-4eea-b224-2ea8d3301d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:27.910831 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac33999-55d3-4eea-b224-2ea8d3301d43 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:27.911112 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac33999-55d3-4eea-b224-2ea8d3301d43 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:27.911384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac33999-55d3-4eea-b224-2ea8d3301d43 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:27.918830 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac33999-55d3-4eea-b224-2ea8d3301d43 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:27.920254 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac33999-55d3-4eea-b224-2ea8d3301d43 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:27.931966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-7ac33999-55d3-4eea-b224-2ea8d3301d43 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:49:27.931966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:27.931966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:27.931966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:27.931966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:27.931966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:27.931966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:27.931966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:27.931966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:27.931966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:27.931966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:27.931966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:27.931966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:49:27.931966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:49:27.931966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:49:27.931966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:49:27.933049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:27.933049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:27.933049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:49:27.933049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:49:27.933049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:49:27.933049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:49:27.933049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:27.933049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:27.933049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:27.933049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:27.933049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:27.933049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:27.933049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:27.933049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:27.933049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:27.933049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:27.933049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:27.933049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:27.934449 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:27.934449 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:27.934449 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:49:27.934449 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:49:27.934449 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:49:27.934449 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:49:27.934449 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:49:27.934449 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:49:27.934449 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:49:27.934449 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:49:27.934449 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 446/888] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:49:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:27.939833 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726efdfa-b5ab-4dc2-9827-982b2b750acc None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:28.037338 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726efdfa-b5ab-4dc2-9827-982b2b750acc None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:28.078729 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cd5ac-e5dd-42f4-bcbd-5f0bcb6cec0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:28.079610 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cd5ac-e5dd-42f4-bcbd-5f0bcb6cec0b None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:28.080076 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cd5ac-e5dd-42f4-bcbd-5f0bcb6cec0b None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:28.080402 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cd5ac-e5dd-42f4-bcbd-5f0bcb6cec0b None admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:28.081435 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cd5ac-e5dd-42f4-bcbd-5f0bcb6cec0b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:28.081972 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cd5ac-e5dd-42f4-bcbd-5f0bcb6cec0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:28.084490 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cd5ac-e5dd-42f4-bcbd-5f0bcb6cec0b None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:28.087478 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:28.102079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 443/889] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Aug 17 14:49:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:49:28.108085 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac33999-55d3-4eea-b224-2ea8d3301d43 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:28.204986 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac33999-55d3-4eea-b224-2ea8d3301d43 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:28.237161 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7011d64-def2-4e32-a35f-ed1f81634979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:28.237783 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7011d64-def2-4e32-a35f-ed1f81634979 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:28.238058 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7011d64-def2-4e32-a35f-ed1f81634979 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:28.238323 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7011d64-def2-4e32-a35f-ed1f81634979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:28.248665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7011d64-def2-4e32-a35f-ed1f81634979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:28.250100 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7011d64-def2-4e32-a35f-ed1f81634979 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:28.263976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-b7011d64-def2-4e32-a35f-ed1f81634979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:28.263976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:28.263976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:28.263976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:28.263976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:28.263976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:28.263976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:28.263976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:28.263976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:28.263976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:28.263976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:28.263976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:28.263976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:49:28.263976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:49:28.263976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:49:28.263976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:49:28.265067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:28.265067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:28.265067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:28.265067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:28.265067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:28.265067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:28.265067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:28.265067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:28.265067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:28.265067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:28.265067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:28.265067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:28.265067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:28.265067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:28.265067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:28.265067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:28.265067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:49:28.266216 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:49:28.266216 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:28.266216 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:49:28.266216 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 447/890] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:28.272151 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cd5ac-e5dd-42f4-bcbd-5f0bcb6cec0b None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:28.369320 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cd5ac-e5dd-42f4-bcbd-5f0bcb6cec0b None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:28.402274 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e9f2e-9e36-48b9-8f9c-7c773c255c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:28.402857 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9f2e-9e36-48b9-8f9c-7c773c255c31 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:28.403130 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9f2e-9e36-48b9-8f9c-7c773c255c31 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:28.403395 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9f2e-9e36-48b9-8f9c-7c773c255c31 None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:28.404027 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e9f2e-9e36-48b9-8f9c-7c773c255c31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:28.404320 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e9f2e-9e36-48b9-8f9c-7c773c255c31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:28.405652 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e9f2e-9e36-48b9-8f9c-7c773c255c31 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:28.417002 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 444/891] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:28.423115 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7011d64-def2-4e32-a35f-ed1f81634979 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:28.455164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:28.523009 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7011d64-def2-4e32-a35f-ed1f81634979 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:28.556140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8958e-afe2-49e2-9311-51f44a1e5eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:28.556759 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8958e-afe2-49e2-9311-51f44a1e5eb0 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:28.557032 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8958e-afe2-49e2-9311-51f44a1e5eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:28.557294 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8958e-afe2-49e2-9311-51f44a1e5eb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:28.563889 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8958e-afe2-49e2-9311-51f44a1e5eb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:28.565312 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8958e-afe2-49e2-9311-51f44a1e5eb0 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:28.577090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-81c8958e-afe2-49e2-9311-51f44a1e5eb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:49:28.577090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:28.577090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:28.577090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:28.577090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:28.577090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:28.577090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:28.577090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:28.577090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:28.577090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:28.577090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:28.577090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:28.577090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:49:28.577090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:49:28.577090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:49:28.578148 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:49:28.578148 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:28.578148 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:28.578148 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:28.578148 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:28.578148 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:28.578148 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:28.578148 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:28.578148 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:28.578148 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:28.578148 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:28.578148 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:28.578148 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:28.578148 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:28.578148 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:28.578148 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:28.578148 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:28.579225 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:49:28.579225 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:49:28.579225 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:49:28.579225 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:49:28.579225 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:49:28.579225 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:49:28.579225 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:49:28.579225 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:49:28.579225 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 448/892] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:49:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:28.583943 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e9f2e-9e36-48b9-8f9c-7c773c255c31 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:28.640818 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:28.684549 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e9f2e-9e36-48b9-8f9c-7c773c255c31 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:28.716974 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdbc79-ea8f-49e9-97d1-48daf64768aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:28.717563 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdbc79-ea8f-49e9-97d1-48daf64768aa None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:28.717873 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdbc79-ea8f-49e9-97d1-48daf64768aa None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:28.718149 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdbc79-ea8f-49e9-97d1-48daf64768aa None admin] PATH_INFO: `/v3/projects` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:28.718830 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdbc79-ea8f-49e9-97d1-48daf64768aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:28.719132 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdbc79-ea8f-49e9-97d1-48daf64768aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:28.720534 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdbc79-ea8f-49e9-97d1-48daf64768aa None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:28.732442 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 445/893] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:49:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:28.738463 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8958e-afe2-49e2-9311-51f44a1e5eb0 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:28.830492 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:28.839459 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8958e-afe2-49e2-9311-51f44a1e5eb0 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:28.873034 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314a88f-3045-404b-a886-22bf7ba702a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:28.873671 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a88f-3045-404b-a886-22bf7ba702a0 None admin] REQUEST_METHOD: `PUT` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:28.873977 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a88f-3045-404b-a886-22bf7ba702a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:28.874251 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a88f-3045-404b-a886-22bf7ba702a0 None admin] PATH_INFO: `/v3/projects/e9d40280440c4d25b6d60a431d6f788b/users/ff30f486b0964765bef7665e2b2a9e35/roles/a307f157f2a445c7af8bd4fd41aa1c4b` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:28.876147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314a88f-3045-404b-a886-22bf7ba702a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9d40280440c4d25b6d60a431d6f788b, user_id=ff30f486b0964765bef7665e2b2a9e35, role_id=a307f157f2a445c7af8bd4fd41aa1c4b)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:28.877558 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314a88f-3045-404b-a886-22bf7ba702a0 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:28.890564 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 449/894] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Aug 17 14:49:28 2022] PUT /identity/v3/projects/e9d40280440c4d25b6d60a431d6f788b/users/ff30f486b0964765bef7665e2b2a9e35/roles/a307f157f2a445c7af8bd4fd41aa1c4b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:49:31.045100 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7de22e-3775-4442-b854-5c8a665330f9 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:31.045655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7de22e-3775-4442-b854-5c8a665330f9 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:31.045655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7de22e-3775-4442-b854-5c8a665330f9 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:31.046998 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 446/895] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:49:31.053685 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa142-9107-460f-9205-337179bb3ec2 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:31.054154 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa142-9107-460f-9205-337179bb3ec2 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:31.054424 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa142-9107-460f-9205-337179bb3ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:31.072585 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-99caa142-9107-460f-9205-337179bb3ec2 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:49:31.073811 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-99caa142-9107-460f-9205-337179bb3ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:49:31.148143 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 450/896] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:49:31 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:49:31.480417 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7de22e-3775-4442-b854-5c8a665330f9 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:31.579941 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7de22e-3775-4442-b854-5c8a665330f9 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:31.593981 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:31.614107 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975faa6-3abe-4db3-a9a0-4bc0e96979b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:31.614820 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975faa6-3abe-4db3-a9a0-4bc0e96979b6 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:31.615091 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975faa6-3abe-4db3-a9a0-4bc0e96979b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:31.615354 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975faa6-3abe-4db3-a9a0-4bc0e96979b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:31.625255 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975faa6-3abe-4db3-a9a0-4bc0e96979b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:49:31.629849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-e975faa6-3abe-4db3-a9a0-4bc0e96979b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:49:31.629849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:31.629849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:31.629849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:31.629849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:31.629849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:31.629849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:31.629849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:31.629849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:31.629849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:31.629849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:31.629849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:31.629849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:49:31.629849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:49:31.629849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:49:31.629849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:49:31.631024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:49:31.631024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:49:31.631024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:49:31.631024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:49:31.631024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:31.631024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:31.631024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:31.631024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:31.631024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:31.631024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:31.631024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:31.631024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:31.631024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:31.631024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:31.631024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:31.631024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:31.632037 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:31.632037 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:31.632037 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:31.632037 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:31.632037 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:49:31.632037 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:49:31.632037 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:49:31.632037 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:49:31.632037 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:49:31.632037 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:49:31.632037 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:49:31.632037 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:31.632037 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 447/897] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Aug 17 14:49:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:31.637081 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caa142-9107-460f-9205-337179bb3ec2 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:31.718024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:31.737089 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caa142-9107-460f-9205-337179bb3ec2 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:31.771781 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7147c6-4e93-47b7-a20c-e7a65d05e732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:31.772373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7147c6-4e93-47b7-a20c-e7a65d05e732 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:31.772654 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7147c6-4e93-47b7-a20c-e7a65d05e732 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:31.772926 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7147c6-4e93-47b7-a20c-e7a65d05e732 None admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:31.773585 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7147c6-4e93-47b7-a20c-e7a65d05e732 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:31.773925 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7147c6-4e93-47b7-a20c-e7a65d05e732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:31.775279 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7147c6-4e93-47b7-a20c-e7a65d05e732 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:31.783156 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 451/898] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Aug 17 14:49:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:31.789380 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975faa6-3abe-4db3-a9a0-4bc0e96979b6 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:31.888422 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975faa6-3abe-4db3-a9a0-4bc0e96979b6 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:31.921703 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a0e5-2d90-40b5-b2cd-bd5962ebaaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:31.922353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a0e5-2d90-40b5-b2cd-bd5962ebaaec None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:31.922638 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a0e5-2d90-40b5-b2cd-bd5962ebaaec None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:31.922913 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a0e5-2d90-40b5-b2cd-bd5962ebaaec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:31.932775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022a0e5-2d90-40b5-b2cd-bd5962ebaaec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:31.934288 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022a0e5-2d90-40b5-b2cd-bd5962ebaaec None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:31.949039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-0022a0e5-2d90-40b5-b2cd-bd5962ebaaec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:31.949039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:31.949039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:31.949039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:31.949039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:31.949039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:31.949039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:31.949039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:31.949039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:31.949039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:31.949039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:31.949039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:31.949039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:49:31.949039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:49:31.949039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:49:31.949039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:49:31.950152 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:31.950152 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:31.950152 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:31.950152 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:31.950152 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:31.950152 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:31.950152 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:31.950152 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:31.950152 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:31.950152 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:31.950152 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:31.950152 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:31.950152 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:31.950152 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:31.950152 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:31.950152 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:31.950152 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:49:31.951168 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:49:31.951168 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:31.951168 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:31.951168 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 448/899] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:49:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:31.955911 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7147c6-4e93-47b7-a20c-e7a65d05e732 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:32.056640 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7147c6-4e93-47b7-a20c-e7a65d05e732 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:32.090066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7d614-4252-47dd-bd6a-96758d58c593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:32.090660 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7d614-4252-47dd-bd6a-96758d58c593 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:32.090940 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7d614-4252-47dd-bd6a-96758d58c593 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:32.091212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7d614-4252-47dd-bd6a-96758d58c593 None admin] PATH_INFO: `/v3/domains` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:32.091847 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7d614-4252-47dd-bd6a-96758d58c593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:32.092147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7d614-4252-47dd-bd6a-96758d58c593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:32.093497 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7d614-4252-47dd-bd6a-96758d58c593 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:32.104819 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 452/900] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:32.110452 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a0e5-2d90-40b5-b2cd-bd5962ebaaec None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:32.139068 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:32.211170 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a0e5-2d90-40b5-b2cd-bd5962ebaaec None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:32.243260 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fba5f0-22c2-4025-ad8b-78d529630d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:32.243865 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fba5f0-22c2-4025-ad8b-78d529630d8c None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:32.244138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fba5f0-22c2-4025-ad8b-78d529630d8c None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:32.244406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fba5f0-22c2-4025-ad8b-78d529630d8c None admin] PATH_INFO: `/v3/users/placement` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:32.251774 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fba5f0-22c2-4025-ad8b-78d529630d8c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:32.253180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fba5f0-22c2-4025-ad8b-78d529630d8c None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:32.264554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-d9fba5f0-22c2-4025-ad8b-78d529630d8c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:49:32.264554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:32.264554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:32.264554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:32.264554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:32.264554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:32.264554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:32.264554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:32.264554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:32.264554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:32.264554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:32.264554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:32.264554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:49:32.264554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:49:32.264554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:49:32.264554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:49:32.265628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:32.265628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:32.265628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:49:32.265628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:49:32.265628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:49:32.265628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:49:32.265628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:32.265628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:32.265628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:32.265628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:32.265628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:32.265628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:32.265628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:32.265628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:32.265628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:32.265628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:32.265628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:32.265628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:32.266584 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:32.266584 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:32.266584 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:49:32.266584 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:49:32.266584 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:49:32.266584 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:49:32.266584 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:49:32.266584 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:49:32.266584 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:49:32.266584 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:32.266584 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 449/901] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:49:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:32.271514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7d614-4252-47dd-bd6a-96758d58c593 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:32.275265 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:32.368893 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7d614-4252-47dd-bd6a-96758d58c593 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:32.402009 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e900572-583c-420d-9207-f8f26ca669dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:32.402599 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e900572-583c-420d-9207-f8f26ca669dc None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:32.402878 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e900572-583c-420d-9207-f8f26ca669dc None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:32.403151 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e900572-583c-420d-9207-f8f26ca669dc None admin] PATH_INFO: `/v3/users` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:32.403864 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e900572-583c-420d-9207-f8f26ca669dc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:32.404164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e900572-583c-420d-9207-f8f26ca669dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:32.405561 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e900572-583c-420d-9207-f8f26ca669dc None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:32.421891 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 453/902] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Aug 17 14:49:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:32.428123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fba5f0-22c2-4025-ad8b-78d529630d8c None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:32.511876 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:32.527187 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fba5f0-22c2-4025-ad8b-78d529630d8c None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:32.560180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef54299-07b2-44ce-97ca-44a66ad08b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:32.560783 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef54299-07b2-44ce-97ca-44a66ad08b23 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:32.561065 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef54299-07b2-44ce-97ca-44a66ad08b23 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:32.561338 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef54299-07b2-44ce-97ca-44a66ad08b23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:32.627538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef54299-07b2-44ce-97ca-44a66ad08b23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:32.628900 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef54299-07b2-44ce-97ca-44a66ad08b23 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:32.709024 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:32.724234 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 450/903] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Aug 17 14:49:32 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:49:32.730014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e900572-583c-420d-9207-f8f26ca669dc None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:32.792398 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:32.830839 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e900572-583c-420d-9207-f8f26ca669dc None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:32.866007 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfddc1a-89a5-464f-a0db-8512001bc663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:32.866620 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfddc1a-89a5-464f-a0db-8512001bc663 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:32.866896 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfddc1a-89a5-464f-a0db-8512001bc663 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:32.867165 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfddc1a-89a5-464f-a0db-8512001bc663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:32.877001 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfddc1a-89a5-464f-a0db-8512001bc663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:32.878502 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfddc1a-89a5-464f-a0db-8512001bc663 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:32.893230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-6cfddc1a-89a5-464f-a0db-8512001bc663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:32.893230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:32.893230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:32.893230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:32.893230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:32.893230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:32.893230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:32.893230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:32.893230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:32.893230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:32.893230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:32.893230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:32.893230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:49:32.893230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:49:32.893230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:49:32.893230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:49:32.894342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:32.894342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:32.894342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:32.894342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:32.894342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:32.894342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:32.894342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:32.894342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:32.894342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:32.894342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:32.894342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:32.894342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:32.894342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:32.894342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:32.894342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:32.894342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:32.894342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:49:32.895304 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:49:32.895304 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:49:32.895304 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:49:32.895304 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 454/904] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:49:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:32.900147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef54299-07b2-44ce-97ca-44a66ad08b23 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:32.995252 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef54299-07b2-44ce-97ca-44a66ad08b23 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:33.027916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ab18f-96ae-4675-8fbd-7b59755c3aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:33.028496 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ab18f-96ae-4675-8fbd-7b59755c3aba None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:33.028770 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ab18f-96ae-4675-8fbd-7b59755c3aba None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:33.029033 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ab18f-96ae-4675-8fbd-7b59755c3aba None admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:33.029657 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ab18f-96ae-4675-8fbd-7b59755c3aba None admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:33.029983 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ab18f-96ae-4675-8fbd-7b59755c3aba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:33.031306 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ab18f-96ae-4675-8fbd-7b59755c3aba None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:33.042320 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 451/905] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Aug 17 14:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:33.047915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfddc1a-89a5-464f-a0db-8512001bc663 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:33.148517 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfddc1a-89a5-464f-a0db-8512001bc663 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:33.161520 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:33.182311 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d481ba-be8f-4c53-9182-b17efebf12a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:33.182920 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d481ba-be8f-4c53-9182-b17efebf12a1 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:33.183195 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d481ba-be8f-4c53-9182-b17efebf12a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:33.183462 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d481ba-be8f-4c53-9182-b17efebf12a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:33.189825 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d481ba-be8f-4c53-9182-b17efebf12a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:33.191246 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d481ba-be8f-4c53-9182-b17efebf12a1 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:33.202748 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application [None req-33d481ba-be8f-4c53-9182-b17efebf12a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:49:33.202748 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:33.202748 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:33.202748 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:33.202748 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:33.202748 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:33.202748 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:33.202748 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:33.202748 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:33.202748 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:33.202748 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:33.202748 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:33.202748 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:49:33.202748 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:49:33.202748 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:49:33.203784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:49:33.203784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:33.203784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:33.203784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:33.203784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:33.203784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:33.203784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:33.203784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:33.203784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:33.203784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:33.203784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:33.203784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:33.203784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:33.203784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:33.203784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:33.203784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:33.203784 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:33.204698 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:49:33.204698 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:49:33.204698 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:49:33.204698 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:49:33.204698 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:49:33.204698 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:49:33.204698 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:49:33.204698 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: ERROR keystone.server.flask.application Aug 17 14:49:33.204698 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 455/906] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Aug 17 14:49:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:33.209916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ab18f-96ae-4675-8fbd-7b59755c3aba None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:33.256287 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:33.311426 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ab18f-96ae-4675-8fbd-7b59755c3aba None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:33.345429 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329ab7f-6899-40b4-b479-f51387047a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:33.346048 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329ab7f-6899-40b4-b479-f51387047a94 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:33.346329 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329ab7f-6899-40b4-b479-f51387047a94 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:33.346601 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329ab7f-6899-40b4-b479-f51387047a94 None admin] PATH_INFO: `/v3/projects` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:33.347282 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329ab7f-6899-40b4-b479-f51387047a94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:33.347582 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329ab7f-6899-40b4-b479-f51387047a94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:33.349537 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329ab7f-6899-40b4-b479-f51387047a94 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:33.360959 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 452/907] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Aug 17 14:49:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:33.367768 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d481ba-be8f-4c53-9182-b17efebf12a1 None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:33.467286 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d481ba-be8f-4c53-9182-b17efebf12a1 None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:33.500921 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68721f-9b82-4a48-a9e2-7a664a81e6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:33.501508 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68721f-9b82-4a48-a9e2-7a664a81e6bc None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:33.501814 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68721f-9b82-4a48-a9e2-7a664a81e6bc None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:33.502086 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68721f-9b82-4a48-a9e2-7a664a81e6bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:33.502796 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68721f-9b82-4a48-a9e2-7a664a81e6bc None admin] RBAC: Adding query filter params (role.id=a307f157f2a445c7af8bd4fd41aa1c4b, scope.project.id=e9d40280440c4d25b6d60a431d6f788b, user.id=ff30f486b0964765bef7665e2b2a9e35) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:33.503098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68721f-9b82-4a48-a9e2-7a664a81e6bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:33.504504 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68721f-9b82-4a48-a9e2-7a664a81e6bc None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:33.510320 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 456/908] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Aug 17 14:49:33 2022] GET /identity/v3/role_assignments?user.id=ff30f486b0964765bef7665e2b2a9e35&scope.project.id=e9d40280440c4d25b6d60a431d6f788b&role.id=a307f157f2a445c7af8bd4fd41aa1c4b => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:35.698133 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144a91e-8aa5-4191-80a3-0fab9721d22f None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:35.698652 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144a91e-8aa5-4191-80a3-0fab9721d22f None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:35.698652 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144a91e-8aa5-4191-80a3-0fab9721d22f None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:35.699985 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 453/909] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:49:35.705108 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a303e-7a55-4ef7-a2da-07a96d5caf25 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:35.705490 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a303e-7a55-4ef7-a2da-07a96d5caf25 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:35.705662 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a303e-7a55-4ef7-a2da-07a96d5caf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:35.724359 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-9a3a303e-7a55-4ef7-a2da-07a96d5caf25 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:49:35.725545 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-9a3a303e-7a55-4ef7-a2da-07a96d5caf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:49:35.754640 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:35.792960 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 457/910] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:49:35 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:49:36.123973 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144a91e-8aa5-4191-80a3-0fab9721d22f None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:36.223222 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144a91e-8aa5-4191-80a3-0fab9721d22f None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:36.230728 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:36.257124 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4563e-96ec-494c-af47-cf8e92992b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:36.257724 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4563e-96ec-494c-af47-cf8e92992b10 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:36.258027 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4563e-96ec-494c-af47-cf8e92992b10 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:36.258293 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4563e-96ec-494c-af47-cf8e92992b10 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:36.258869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4563e-96ec-494c-af47-cf8e92992b10 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:36.260211 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4563e-96ec-494c-af47-cf8e92992b10 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:36.268550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-4bd4563e-96ec-494c-af47-cf8e92992b10 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 14:49:36.268550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:36.268550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:49:36.268550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:49:36.268550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:49:36.268550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:49:36.268550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:49:36.268550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:49:36.268550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 14:49:36.268550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:36.268550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:49:36.268550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:36.268550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:36.268550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:36.268550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:36.268550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:36.268550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:36.269772 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:36.269772 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:36.269772 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:36.269772 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:36.269772 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:36.269772 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:36.269772 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:49:36.269772 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:49:36.269772 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:49:36.269772 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:49:36.269772 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:36.269772 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:36.269772 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:36.269772 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:36.269772 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:36.269772 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:36.270879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:36.270879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:36.270879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:36.270879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:36.270879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:36.270879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:36.270879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:36.270879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:36.270879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:36.270879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:36.270879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:49:36.270879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:49:36.270879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 14:49:36.270879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:36.270879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 454/911] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Aug 17 14:49:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:36.275785 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a303e-7a55-4ef7-a2da-07a96d5caf25 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:36.373818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a303e-7a55-4ef7-a2da-07a96d5caf25 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:36.407119 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fdd11-630a-4002-ba36-9bcef2fc81fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:36.407644 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fdd11-630a-4002-ba36-9bcef2fc81fa None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:36.407924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fdd11-630a-4002-ba36-9bcef2fc81fa None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:36.408193 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fdd11-630a-4002-ba36-9bcef2fc81fa None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:36.408811 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fdd11-630a-4002-ba36-9bcef2fc81fa None admin] RBAC: Adding query filter params (name=placement) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:36.409109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fdd11-630a-4002-ba36-9bcef2fc81fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:36.410484 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fdd11-630a-4002-ba36-9bcef2fc81fa None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:36.415579 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 458/912] 10.222.0.30 () {56 vars in 1116 bytes} [Wed Aug 17 14:49:36 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:36.421185 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4563e-96ec-494c-af47-cf8e92992b10 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:36.517991 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4563e-96ec-494c-af47-cf8e92992b10 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:36.550030 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adbf37-e8ac-4930-bd64-a77bd316c059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:36.550620 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adbf37-e8ac-4930-bd64-a77bd316c059 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:36.550897 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adbf37-e8ac-4930-bd64-a77bd316c059 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:36.551166 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adbf37-e8ac-4930-bd64-a77bd316c059 None admin] PATH_INFO: `/v3/services` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:36.551941 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adbf37-e8ac-4930-bd64-a77bd316c059 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:36.552383 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adbf37-e8ac-4930-bd64-a77bd316c059 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:36.553786 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adbf37-e8ac-4930-bd64-a77bd316c059 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:36.558372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 455/913] 10.222.0.30 () {56 vars in 1116 bytes} [Wed Aug 17 14:49:36 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:38.738291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646b803-bc21-4c56-8618-7a88ea73c89d None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:38.738839 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646b803-bc21-4c56-8618-7a88ea73c89d None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:38.738839 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646b803-bc21-4c56-8618-7a88ea73c89d None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:38.741664 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 459/914] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:49:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:49:38.746965 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a80d15-4bbc-423e-ac9a-cd4ad8e5b7a8 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:38.747366 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a80d15-4bbc-423e-ac9a-cd4ad8e5b7a8 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:38.747504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a80d15-4bbc-423e-ac9a-cd4ad8e5b7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:38.765271 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-e1a80d15-4bbc-423e-ac9a-cd4ad8e5b7a8 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:49:38.766495 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-e1a80d15-4bbc-423e-ac9a-cd4ad8e5b7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:49:38.792798 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:38.831963 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 456/915] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:49:38 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:49:39.184839 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646b803-bc21-4c56-8618-7a88ea73c89d None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:39.215993 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:39.286382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646b803-bc21-4c56-8618-7a88ea73c89d None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:39.319749 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcb9e1-b777-4c16-b76f-8b343924a835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:39.320322 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcb9e1-b777-4c16-b76f-8b343924a835 None admin] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:39.320596 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcb9e1-b777-4c16-b76f-8b343924a835 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:39.320863 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcb9e1-b777-4c16-b76f-8b343924a835 None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:39.321499 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcb9e1-b777-4c16-b76f-8b343924a835 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:39.322883 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcb9e1-b777-4c16-b76f-8b343924a835 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:39.337716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 460/916] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Aug 17 14:49:39 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:49:41.516899 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734adc7-e757-4b08-b8e5-6554b7b6d34c None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:41.517461 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734adc7-e757-4b08-b8e5-6554b7b6d34c None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:41.517461 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734adc7-e757-4b08-b8e5-6554b7b6d34c None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:41.518801 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 457/917] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:49:41.524400 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f30743-b030-47dd-8eb2-394293005338 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:41.524778 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f30743-b030-47dd-8eb2-394293005338 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:41.524955 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f30743-b030-47dd-8eb2-394293005338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:41.543084 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-b8f30743-b030-47dd-8eb2-394293005338 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:49:41.544260 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-b8f30743-b030-47dd-8eb2-394293005338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:49:41.617344 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 461/918] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:49:41 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:49:41.952020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734adc7-e757-4b08-b8e5-6554b7b6d34c None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:42.052004 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734adc7-e757-4b08-b8e5-6554b7b6d34c None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:42.092906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dd800-b98d-4c8c-9011-3b9a99e59b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:42.093607 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dd800-b98d-4c8c-9011-3b9a99e59b2e None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:42.093955 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dd800-b98d-4c8c-9011-3b9a99e59b2e None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:42.094312 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dd800-b98d-4c8c-9011-3b9a99e59b2e None admin] PATH_INFO: `/v3/services/placement` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:42.094974 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9dd800-b98d-4c8c-9011-3b9a99e59b2e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:42.096617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9dd800-b98d-4c8c-9011-3b9a99e59b2e None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:42.107389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-9d9dd800-b98d-4c8c-9011-3b9a99e59b2e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 14:49:42.107389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:42.107389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:49:42.107389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:49:42.107389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:49:42.107389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:49:42.107389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:49:42.107389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:49:42.107389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 14:49:42.107389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:42.107389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:49:42.107389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:42.107389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:42.107389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:42.107389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:42.107389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:42.107389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:42.109921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:42.109921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:42.109921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:42.109921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:42.109921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:42.109921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:42.109921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:49:42.109921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:49:42.109921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:49:42.109921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:49:42.109921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:42.109921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:42.109921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:42.109921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:42.109921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:42.109921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:42.110968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:42.110968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:42.110968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:42.110968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:42.110968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:42.110968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:42.110968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:42.110968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:42.110968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:42.110968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:42.110968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:49:42.110968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:49:42.110968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 14:49:42.110968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:42.110968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 458/919] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Aug 17 14:49:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:42.115309 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f30743-b030-47dd-8eb2-394293005338 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:42.136276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:42.216210 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f30743-b030-47dd-8eb2-394293005338 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:42.249451 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08feeb02-29c8-450b-bd45-588bade50f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:42.250073 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08feeb02-29c8-450b-bd45-588bade50f9b None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:42.250353 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08feeb02-29c8-450b-bd45-588bade50f9b None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:42.250625 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08feeb02-29c8-450b-bd45-588bade50f9b None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:42.251258 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08feeb02-29c8-450b-bd45-588bade50f9b None admin] RBAC: Adding query filter params (name=placement) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:42.251558 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08feeb02-29c8-450b-bd45-588bade50f9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:42.252913 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08feeb02-29c8-450b-bd45-588bade50f9b None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:42.258326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 462/920] 10.222.0.30 () {56 vars in 1116 bytes} [Wed Aug 17 14:49:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:42.264193 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dd800-b98d-4c8c-9011-3b9a99e59b2e None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:42.292618 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:42.362113 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dd800-b98d-4c8c-9011-3b9a99e59b2e None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:42.394841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa8837-2dbd-4668-8a1d-dde6e004aa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:42.396069 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa8837-2dbd-4668-8a1d-dde6e004aa0a None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:42.396415 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa8837-2dbd-4668-8a1d-dde6e004aa0a None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:42.396680 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa8837-2dbd-4668-8a1d-dde6e004aa0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:42.397371 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa8837-2dbd-4668-8a1d-dde6e004aa0a None admin] RBAC: Adding query filter params (interface=public, service_id=6e7716bb95594dbdbbf2e1a44a92cdc5, region_id=RegionOne) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:42.397671 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa8837-2dbd-4668-8a1d-dde6e004aa0a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:42.399044 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa8837-2dbd-4668-8a1d-dde6e004aa0a None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:42.403802 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 459/921] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Aug 17 14:49:42 2022] GET /identity/v3/endpoints?service_id=6e7716bb95594dbdbbf2e1a44a92cdc5&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:42.409514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08feeb02-29c8-450b-bd45-588bade50f9b None admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:42.488002 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:42.506902 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08feeb02-29c8-450b-bd45-588bade50f9b None admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:42.540123 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1e166-8b7c-4238-871c-e2bcfa01aa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:42.540708 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1e166-8b7c-4238-871c-e2bcfa01aa19 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:42.540980 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1e166-8b7c-4238-871c-e2bcfa01aa19 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:42.541245 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1e166-8b7c-4238-871c-e2bcfa01aa19 None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:42.541861 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1e166-8b7c-4238-871c-e2bcfa01aa19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:42.543207 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1e166-8b7c-4238-871c-e2bcfa01aa19 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:42.549495 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 463/922] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Aug 17 14:49:42 2022] GET /identity/v3/services => generated 1962 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:49:44.728936 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6870e-8b40-4e16-bc8f-dd07ebe42fa4 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:44.729455 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6870e-8b40-4e16-bc8f-dd07ebe42fa4 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:44.729455 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6870e-8b40-4e16-bc8f-dd07ebe42fa4 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:44.730833 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 460/923] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:49:44.735813 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7197fc-2077-4b52-9816-36b78bc83baa None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:44.736192 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7197fc-2077-4b52-9816-36b78bc83baa None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:44.736363 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7197fc-2077-4b52-9816-36b78bc83baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:44.754427 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-ca7197fc-2077-4b52-9816-36b78bc83baa None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:49:44.756131 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-ca7197fc-2077-4b52-9816-36b78bc83baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:49:44.821713 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 464/924] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:49:44 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:49:45.150514 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6870e-8b40-4e16-bc8f-dd07ebe42fa4 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:45.240713 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:45.250961 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6870e-8b40-4e16-bc8f-dd07ebe42fa4 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:45.285278 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190a534-3ff2-4f48-9c49-8dd3525de7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:45.286521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190a534-3ff2-4f48-9c49-8dd3525de7c8 None admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:45.286818 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190a534-3ff2-4f48-9c49-8dd3525de7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:45.287254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190a534-3ff2-4f48-9c49-8dd3525de7c8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:45.287872 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190a534-3ff2-4f48-9c49-8dd3525de7c8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:45.289230 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190a534-3ff2-4f48-9c49-8dd3525de7c8 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:45.297869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application [None req-4190a534-3ff2-4f48-9c49-8dd3525de7c8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 14:49:45.297869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:45.297869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:49:45.297869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:49:45.297869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:49:45.297869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:49:45.297869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:49:45.297869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:49:45.297869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 14:49:45.297869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:45.297869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:49:45.297869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:45.297869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:49:45.297869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:49:45.297869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:49:45.297869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:49:45.297869 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:49:45.298910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:49:45.298910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:49:45.298910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:49:45.298910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:49:45.298910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:49:45.298910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:49:45.298910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:49:45.298910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:49:45.298910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:49:45.298910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:49:45.298910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:49:45.298910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:49:45.298910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:49:45.298910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:49:45.298910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:49:45.298910 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:49:45.299957 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:49:45.299957 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application with Lock( Aug 17 14:49:45.299957 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:49:45.299957 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:49:45.299957 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:49:45.299957 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:49:45.299957 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:49:45.299957 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:49:45.299957 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:49:45.299957 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:49:45.299957 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:49:45.299957 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:49:45.299957 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 14:49:45.299957 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: ERROR keystone.server.flask.application Aug 17 14:49:45.299957 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 461/925] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Aug 17 14:49:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:49:45.305876 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7197fc-2077-4b52-9816-36b78bc83baa None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:45.380989 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:45.404159 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7197fc-2077-4b52-9816-36b78bc83baa None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:45.438306 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024f59b-ef89-4e32-9985-536947cf2380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:45.438894 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024f59b-ef89-4e32-9985-536947cf2380 None admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:45.439167 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024f59b-ef89-4e32-9985-536947cf2380 None admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:45.439432 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024f59b-ef89-4e32-9985-536947cf2380 None admin] PATH_INFO: `/v3/services` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:45.440050 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024f59b-ef89-4e32-9985-536947cf2380 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:49:45.440348 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024f59b-ef89-4e32-9985-536947cf2380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:45.441716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024f59b-ef89-4e32-9985-536947cf2380 None admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:45.446656 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 465/926] 10.222.0.30 () {56 vars in 1116 bytes} [Wed Aug 17 14:49:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:49:45.452416 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190a534-3ff2-4f48-9c49-8dd3525de7c8 None admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:49:45.550116 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190a534-3ff2-4f48-9c49-8dd3525de7c8 None admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:49:45.585050 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c214f-5523-477f-8353-8483d1cd6ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:49:45.585641 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c214f-5523-477f-8353-8483d1cd6ef8 None admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:49:45.585954 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c214f-5523-477f-8353-8483d1cd6ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:49:45.586229 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c214f-5523-477f-8353-8483d1cd6ef8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:49:45.586939 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c214f-5523-477f-8353-8483d1cd6ef8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:49:45.588290 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c214f-5523-477f-8353-8483d1cd6ef8 None admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:49:45.608119 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 462/927] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 17 14:49:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:49:55.443838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=30 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:49:55.603906 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:50:45.532612 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5874df-c9c4-4d9c-b55d-25190f67e673 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:50:45.533181 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5874df-c9c4-4d9c-b55d-25190f67e673 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:50:45.533181 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5874df-c9c4-4d9c-b55d-25190f67e673 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:50:45.534524 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 466/928] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:50:45.540753 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4a959-beb8-4d6f-9da5-87e9b7804d97 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:50:45.541210 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4a959-beb8-4d6f-9da5-87e9b7804d97 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:50:45.541395 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4a959-beb8-4d6f-9da5-87e9b7804d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:50:45.563275 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-82e4a959-beb8-4d6f-9da5-87e9b7804d97 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:50:45.564493 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-82e4a959-beb8-4d6f-9da5-87e9b7804d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:50:45.669812 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 463/929] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:50:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:50:46.033818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47334218-f253-45ad-896c-7516f302240b None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:50:46.034269 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47334218-f253-45ad-896c-7516f302240b None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:50:46.034658 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47334218-f253-45ad-896c-7516f302240b None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:50:46.036988 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 467/930] 10.222.0.30 () {54 vars in 965 bytes} [Wed Aug 17 14:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:50:46.044252 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae5af9-3a8f-410d-ba3d-6624a6dab746 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:50:46.044734 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae5af9-3a8f-410d-ba3d-6624a6dab746 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:50:46.045866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae5af9-3a8f-410d-ba3d-6624a6dab746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:50:46.143031 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-70ae5af9-3a8f-410d-ba3d-6624a6dab746 None None] MFA Rules not processed for user `1e4147647f54499ba24b50fbecc5d38f`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:50:46.144840 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-70ae5af9-3a8f-410d-ba3d-6624a6dab746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:50:46.208491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 464/931] 10.222.0.30 () {58 vars in 1062 bytes} [Wed Aug 17 14:50:46 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:50:46.217523 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47334218-f253-45ad-896c-7516f302240b None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:50:46.228966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47334218-f253-45ad-896c-7516f302240b None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:50:46.232595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc5e8f-d151-4ebb-957d-f5ceac6850d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:50:46.233298 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc5e8f-d151-4ebb-957d-f5ceac6850d8 service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:50:46.233846 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc5e8f-d151-4ebb-957d-f5ceac6850d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:50:46.234309 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc5e8f-d151-4ebb-957d-f5ceac6850d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:50:46.244936 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc5e8f-d151-4ebb-957d-f5ceac6850d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:50:46.246629 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc5e8f-d151-4ebb-957d-f5ceac6850d8 service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:50:46.257668 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 468/932] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:50:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:50:48.848466 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff5fea-2e01-450f-9bd1-6d3bb422644d None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:50:48.848999 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff5fea-2e01-450f-9bd1-6d3bb422644d None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:50:48.849254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff5fea-2e01-450f-9bd1-6d3bb422644d None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:50:48.853163 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 465/933] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:50:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:50:48.855556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ee56b-a834-4e2a-8620-5a377ffb40dd None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:50:48.855968 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ee56b-a834-4e2a-8620-5a377ffb40dd None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:50:48.856138 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ee56b-a834-4e2a-8620-5a377ffb40dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:50:48.879486 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-364ee56b-a834-4e2a-8620-5a377ffb40dd None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:50:48.881027 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-364ee56b-a834-4e2a-8620-5a377ffb40dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:50:48.889192 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 469/934] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:50:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:50:49.242389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff5fea-2e01-450f-9bd1-6d3bb422644d None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:50:49.253317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff5fea-2e01-450f-9bd1-6d3bb422644d None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:50:49.257621 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b7083-ccac-4791-b322-24aeaec32aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:50:49.258246 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b7083-ccac-4791-b322-24aeaec32aae service neutron] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:50:49.258521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b7083-ccac-4791-b322-24aeaec32aae service neutron] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:50:49.258792 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b7083-ccac-4791-b322-24aeaec32aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:50:49.268266 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b7083-ccac-4791-b322-24aeaec32aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:50:49.270314 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b7083-ccac-4791-b322-24aeaec32aae service neutron] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:50:49.280379 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 466/935] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:50:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:50:51.806559 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ef1a4-b2b8-4655-a06a-7fe59ae016c3 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:50:51.807071 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ef1a4-b2b8-4655-a06a-7fe59ae016c3 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:50:51.807071 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ef1a4-b2b8-4655-a06a-7fe59ae016c3 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:50:51.808348 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 470/936] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:50:51.813517 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb064c-a2d3-4ecb-9534-dde34633a56d None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:50:51.813988 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb064c-a2d3-4ecb-9534-dde34633a56d None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:50:51.814234 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb064c-a2d3-4ecb-9534-dde34633a56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:50:51.851849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-dadb064c-a2d3-4ecb-9534-dde34633a56d None None] MFA Rules not processed for user `2887a095d202430d88cb368b25d74f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:50:51.853059 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-dadb064c-a2d3-4ecb-9534-dde34633a56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:50:51.892043 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:50:51.920351 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 467/937] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:50:51 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:50:52.283495 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cf63a-7577-484f-ac7d-52623d37f597 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:50:52.283801 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cf63a-7577-484f-ac7d-52623d37f597 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:50:52.284079 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cf63a-7577-484f-ac7d-52623d37f597 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:50:52.285780 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 471/938] 10.222.0.30 () {54 vars in 965 bytes} [Wed Aug 17 14:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:50:52.291568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb8aab-49bc-4486-8fc7-0ea435dd7353 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:50:52.291852 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb8aab-49bc-4486-8fc7-0ea435dd7353 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:50:52.292124 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb8aab-49bc-4486-8fc7-0ea435dd7353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:50:52.313449 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-f6eb8aab-49bc-4486-8fc7-0ea435dd7353 None None] MFA Rules not processed for user `1e4147647f54499ba24b50fbecc5d38f`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:50:52.314668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-f6eb8aab-49bc-4486-8fc7-0ea435dd7353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:50:52.321842 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 468/939] 10.222.0.30 () {58 vars in 1062 bytes} [Wed Aug 17 14:50:52 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:50:52.330928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cf63a-7577-484f-ac7d-52623d37f597 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:50:52.341578 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cf63a-7577-484f-ac7d-52623d37f597 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:50:52.344988 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151fe47-7c64-44ac-8848-efc9e0396618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:50:52.345576 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151fe47-7c64-44ac-8848-efc9e0396618 service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:50:52.345883 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151fe47-7c64-44ac-8848-efc9e0396618 service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:50:52.346153 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151fe47-7c64-44ac-8848-efc9e0396618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:50:52.355573 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151fe47-7c64-44ac-8848-efc9e0396618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:50:52.357000 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151fe47-7c64-44ac-8848-efc9e0396618 service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:50:52.367024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 472/940] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:50:52 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:50:55.477993 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e022f1-786e-4f61-bff8-b9177b7e2779 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:50:55.478523 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e022f1-786e-4f61-bff8-b9177b7e2779 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:50:55.478523 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e022f1-786e-4f61-bff8-b9177b7e2779 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:50:55.479850 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 469/941] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:50:55.485010 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81f10d-a120-429e-a2ac-61106f2ae6e7 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:50:55.485385 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81f10d-a120-429e-a2ac-61106f2ae6e7 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:50:55.485553 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81f10d-a120-429e-a2ac-61106f2ae6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:50:55.505653 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-0e81f10d-a120-429e-a2ac-61106f2ae6e7 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:50:55.506936 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-0e81f10d-a120-429e-a2ac-61106f2ae6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:50:55.573995 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 473/942] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:50:55 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:50:55.919724 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e022f1-786e-4f61-bff8-b9177b7e2779 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:50:55.930545 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e022f1-786e-4f61-bff8-b9177b7e2779 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:50:55.933983 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3797e-4848-4ed3-bbcc-fdfb81ffa29e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:50:55.934562 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3797e-4848-4ed3-bbcc-fdfb81ffa29e service neutron] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:50:55.934838 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3797e-4848-4ed3-bbcc-fdfb81ffa29e service neutron] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:50:55.935104 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3797e-4848-4ed3-bbcc-fdfb81ffa29e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:50:55.946193 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3797e-4848-4ed3-bbcc-fdfb81ffa29e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:50:55.947600 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3797e-4848-4ed3-bbcc-fdfb81ffa29e service neutron] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:50:55.958035 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 470/943] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:50:55 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:50:58.820156 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d2837-c9fc-416d-be9a-28880767b02a None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:50:58.820676 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d2837-c9fc-416d-be9a-28880767b02a None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:50:58.820676 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d2837-c9fc-416d-be9a-28880767b02a None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:50:58.822127 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 474/944] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:50:58.827319 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cfc58-92aa-4154-85e4-e0c809f2fc11 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:50:58.828069 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cfc58-92aa-4154-85e4-e0c809f2fc11 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:50:58.828343 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cfc58-92aa-4154-85e4-e0c809f2fc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:50:58.848124 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-489cfc58-92aa-4154-85e4-e0c809f2fc11 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:50:58.849435 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-489cfc58-92aa-4154-85e4-e0c809f2fc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:50:58.857346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 471/945] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:50:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:50:59.197128 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d2837-c9fc-416d-be9a-28880767b02a None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:50:59.208160 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d2837-c9fc-416d-be9a-28880767b02a None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:50:59.211576 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02e102-07a5-4ed9-8aa4-46abf19c0484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:50:59.212156 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02e102-07a5-4ed9-8aa4-46abf19c0484 service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:50:59.212432 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02e102-07a5-4ed9-8aa4-46abf19c0484 service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:50:59.212701 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02e102-07a5-4ed9-8aa4-46abf19c0484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:50:59.221771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02e102-07a5-4ed9-8aa4-46abf19c0484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:50:59.223903 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02e102-07a5-4ed9-8aa4-46abf19c0484 service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:50:59.233415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 475/946] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:50:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:51:01.471561 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7fe37-fde9-4ddf-97a6-864fde4bf5a5 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:01.473023 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7fe37-fde9-4ddf-97a6-864fde4bf5a5 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:01.473257 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7fe37-fde9-4ddf-97a6-864fde4bf5a5 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:01.474617 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 472/947] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:51:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:01.479666 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c335945-e58a-49b9-b595-120e44c8b402 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:01.480050 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c335945-e58a-49b9-b595-120e44c8b402 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:01.480212 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c335945-e58a-49b9-b595-120e44c8b402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:01.499583 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-5c335945-e58a-49b9-b595-120e44c8b402 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:01.500765 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-5c335945-e58a-49b9-b595-120e44c8b402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:01.508555 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 476/948] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:51:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:51:01.850131 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7fe37-fde9-4ddf-97a6-864fde4bf5a5 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:51:01.860745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7fe37-fde9-4ddf-97a6-864fde4bf5a5 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:51:01.864922 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7e487-aaaa-4273-8d17-66864e41f617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:51:01.865501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7e487-aaaa-4273-8d17-66864e41f617 service neutron] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:01.865814 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7e487-aaaa-4273-8d17-66864e41f617 service neutron] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:01.866088 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7e487-aaaa-4273-8d17-66864e41f617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:01.875135 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7e487-aaaa-4273-8d17-66864e41f617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:51:01.876553 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7e487-aaaa-4273-8d17-66864e41f617 service neutron] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:51:01.886714 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 473/949] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:51:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:51:04.148978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21880821-2d05-413a-915d-49cea305f914 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:04.149505 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21880821-2d05-413a-915d-49cea305f914 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:04.150103 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21880821-2d05-413a-915d-49cea305f914 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:04.151437 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 477/950] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:04.156696 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068842-fdd6-48df-8808-40c7d7d135fc None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:04.157118 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068842-fdd6-48df-8808-40c7d7d135fc None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:04.157235 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068842-fdd6-48df-8808-40c7d7d135fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:04.177336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-a0068842-fdd6-48df-8808-40c7d7d135fc None None] MFA Rules not processed for user `2887a095d202430d88cb368b25d74f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:04.178546 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-a0068842-fdd6-48df-8808-40c7d7d135fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:04.186238 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 474/951] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:51:04 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:51:04.533347 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21880821-2d05-413a-915d-49cea305f914 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:51:04.544947 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21880821-2d05-413a-915d-49cea305f914 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:51:04.548445 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ef637-8510-42e0-b240-6b0a9ddb7c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:51:04.549038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ef637-8510-42e0-b240-6b0a9ddb7c61 service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:04.549319 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ef637-8510-42e0-b240-6b0a9ddb7c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:04.550624 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ef637-8510-42e0-b240-6b0a9ddb7c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:04.563003 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ef637-8510-42e0-b240-6b0a9ddb7c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:51:04.564429 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ef637-8510-42e0-b240-6b0a9ddb7c61 service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:51:04.573938 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 478/952] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:51:04 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:51:06.984373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147548d-726f-4b21-b0b1-c1e186200e8c None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:06.984881 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147548d-726f-4b21-b0b1-c1e186200e8c None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:06.984881 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147548d-726f-4b21-b0b1-c1e186200e8c None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:06.986385 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 475/953] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:06.992372 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e9c7b-d230-4cac-9845-09a707bb702f None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:06.992798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e9c7b-d230-4cac-9845-09a707bb702f None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:06.992923 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e9c7b-d230-4cac-9845-09a707bb702f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:07.012181 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-527e9c7b-d230-4cac-9845-09a707bb702f None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:07.013382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-527e9c7b-d230-4cac-9845-09a707bb702f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:07.021299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 479/954] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:51:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:51:07.366412 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147548d-726f-4b21-b0b1-c1e186200e8c None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:51:07.377078 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147548d-726f-4b21-b0b1-c1e186200e8c None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:51:07.380870 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ed99d-9431-4884-9aa9-ed6af93c7804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:51:07.381444 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ed99d-9431-4884-9aa9-ed6af93c7804 service neutron] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:07.381716 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ed99d-9431-4884-9aa9-ed6af93c7804 service neutron] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:07.382014 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ed99d-9431-4884-9aa9-ed6af93c7804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:07.390638 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ed99d-9431-4884-9aa9-ed6af93c7804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:51:07.392043 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ed99d-9431-4884-9aa9-ed6af93c7804 service neutron] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:51:07.402100 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 476/955] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:51:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:51:09.673097 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47c73c-2038-4de5-bdfd-0613bad5146f None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:09.673650 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47c73c-2038-4de5-bdfd-0613bad5146f None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:09.673650 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47c73c-2038-4de5-bdfd-0613bad5146f None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:09.675025 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 480/956] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:09.680213 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae9e62-e52d-4c60-8332-3ebd99812b10 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:09.680655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae9e62-e52d-4c60-8332-3ebd99812b10 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:09.680884 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae9e62-e52d-4c60-8332-3ebd99812b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:09.699799 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-c9ae9e62-e52d-4c60-8332-3ebd99812b10 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:09.700989 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-c9ae9e62-e52d-4c60-8332-3ebd99812b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:09.709243 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 477/957] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:51:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:51:10.053354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47c73c-2038-4de5-bdfd-0613bad5146f None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:51:10.068743 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47c73c-2038-4de5-bdfd-0613bad5146f None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:51:10.075413 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04f627-1b2a-4c19-b6d5-f8ddc72bb6dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:51:10.076020 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04f627-1b2a-4c19-b6d5-f8ddc72bb6dd service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:10.076304 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04f627-1b2a-4c19-b6d5-f8ddc72bb6dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:10.076574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04f627-1b2a-4c19-b6d5-f8ddc72bb6dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:10.087268 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04f627-1b2a-4c19-b6d5-f8ddc72bb6dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:51:10.088703 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04f627-1b2a-4c19-b6d5-f8ddc72bb6dd service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:51:10.098756 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 481/958] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:51:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:51:12.735709 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409de92d-93fe-4f77-9a86-8a998e479bb7 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:12.736252 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409de92d-93fe-4f77-9a86-8a998e479bb7 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:12.736252 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409de92d-93fe-4f77-9a86-8a998e479bb7 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:12.738204 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 478/959] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:51:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:12.743505 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647075d-4cc5-4e01-bb83-f0d179a98e41 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:12.744136 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647075d-4cc5-4e01-bb83-f0d179a98e41 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:12.744298 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647075d-4cc5-4e01-bb83-f0d179a98e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:12.763674 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-d647075d-4cc5-4e01-bb83-f0d179a98e41 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:12.764853 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-d647075d-4cc5-4e01-bb83-f0d179a98e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:12.772821 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 482/960] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:51:12 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:51:13.110456 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409de92d-93fe-4f77-9a86-8a998e479bb7 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:51:13.122040 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409de92d-93fe-4f77-9a86-8a998e479bb7 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:51:13.125472 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015446a-f29c-4841-82ad-bdc5d40ffce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:51:13.126151 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015446a-f29c-4841-82ad-bdc5d40ffce1 service neutron] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:13.126426 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015446a-f29c-4841-82ad-bdc5d40ffce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:13.126692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015446a-f29c-4841-82ad-bdc5d40ffce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:13.135253 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015446a-f29c-4841-82ad-bdc5d40ffce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:51:13.136654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015446a-f29c-4841-82ad-bdc5d40ffce1 service neutron] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:51:13.145895 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 479/961] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:51:13 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:51:17.294835 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38c29d-6c49-4886-9956-7897d698e036 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:17.295352 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38c29d-6c49-4886-9956-7897d698e036 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:17.295352 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38c29d-6c49-4886-9956-7897d698e036 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:17.296673 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 483/962] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:17.302878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7b7cd-ff5f-4eff-902c-3e7c9c0e4d43 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:17.303302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7b7cd-ff5f-4eff-902c-3e7c9c0e4d43 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:17.303562 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7b7cd-ff5f-4eff-902c-3e7c9c0e4d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:17.323035 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-a4e7b7cd-ff5f-4eff-902c-3e7c9c0e4d43 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:17.324217 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-a4e7b7cd-ff5f-4eff-902c-3e7c9c0e4d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:17.332134 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 480/963] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:51:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:51:17.684252 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38c29d-6c49-4886-9956-7897d698e036 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:51:17.689652 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=74 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:51:17.696618 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38c29d-6c49-4886-9956-7897d698e036 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:51:17.700091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf649ef2-9d5b-44cd-a130-637565b7782e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:51:17.700804 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf649ef2-9d5b-44cd-a130-637565b7782e service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:17.701085 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf649ef2-9d5b-44cd-a130-637565b7782e service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:17.701356 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf649ef2-9d5b-44cd-a130-637565b7782e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:17.710697 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf649ef2-9d5b-44cd-a130-637565b7782e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:51:17.712113 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf649ef2-9d5b-44cd-a130-637565b7782e service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:51:17.722195 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 484/964] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:51:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:51:20.578451 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad36d9-8621-42a2-abc4-00343f4c53dc None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:20.579007 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad36d9-8621-42a2-abc4-00343f4c53dc None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:20.579007 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad36d9-8621-42a2-abc4-00343f4c53dc None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:20.580313 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 481/965] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:20.586077 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6755bc-eda5-44f8-877d-33179fc2dca7 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:20.586488 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6755bc-eda5-44f8-877d-33179fc2dca7 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:20.586627 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6755bc-eda5-44f8-877d-33179fc2dca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:20.605774 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-8f6755bc-eda5-44f8-877d-33179fc2dca7 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:20.606963 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-8f6755bc-eda5-44f8-877d-33179fc2dca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:20.615139 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 485/966] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:51:20 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:51:20.962075 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad36d9-8621-42a2-abc4-00343f4c53dc None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:51:20.973311 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad36d9-8621-42a2-abc4-00343f4c53dc None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:51:20.976850 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc5719-e194-4763-a82f-0b89bac9669e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:51:20.977501 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc5719-e194-4763-a82f-0b89bac9669e service neutron] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:20.977872 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc5719-e194-4763-a82f-0b89bac9669e service neutron] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:20.978206 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc5719-e194-4763-a82f-0b89bac9669e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:20.987177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc5719-e194-4763-a82f-0b89bac9669e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:51:20.988587 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc5719-e194-4763-a82f-0b89bac9669e service neutron] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:51:20.998414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 482/967] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:51:20 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:51:25.162064 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0242576-ab96-43bb-a444-6be7a726d511 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:25.162547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0242576-ab96-43bb-a444-6be7a726d511 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:25.162647 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0242576-ab96-43bb-a444-6be7a726d511 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:25.163931 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 486/968] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:25.169517 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a1945-d693-4cc2-8cd7-44a85df21e12 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:25.170000 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a1945-d693-4cc2-8cd7-44a85df21e12 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:25.170078 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a1945-d693-4cc2-8cd7-44a85df21e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:25.179224 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=57 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:51:25.193770 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-6e3a1945-d693-4cc2-8cd7-44a85df21e12 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:25.195832 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-6e3a1945-d693-4cc2-8cd7-44a85df21e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:25.204097 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 483/969] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:51:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:51:25.548341 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0242576-ab96-43bb-a444-6be7a726d511 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:51:25.559648 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0242576-ab96-43bb-a444-6be7a726d511 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:51:25.563189 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22231c96-735d-4734-b5ac-1062792c00da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:51:25.563779 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22231c96-735d-4734-b5ac-1062792c00da service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:25.564065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22231c96-735d-4734-b5ac-1062792c00da service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:25.564331 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22231c96-735d-4734-b5ac-1062792c00da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:25.574591 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22231c96-735d-4734-b5ac-1062792c00da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:51:25.576007 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22231c96-735d-4734-b5ac-1062792c00da service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:51:25.586330 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 487/970] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:51:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:51:31.082981 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636958-3679-48a7-b7c7-3ef97c8ab2d0 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:31.083468 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636958-3679-48a7-b7c7-3ef97c8ab2d0 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:31.083545 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636958-3679-48a7-b7c7-3ef97c8ab2d0 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:31.094173 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 484/971] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 17 14:51:31 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:31.100824 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b39667-b429-4e3e-a339-efbfbf70e81a None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:31.101292 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b39667-b429-4e3e-a339-efbfbf70e81a None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:31.101397 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b39667-b429-4e3e-a339-efbfbf70e81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:31.181257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-12b39667-b429-4e3e-a339-efbfbf70e81a None None] MFA Rules not processed for user `ff30f486b0964765bef7665e2b2a9e35`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:31.182369 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-12b39667-b429-4e3e-a339-efbfbf70e81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:31.353114 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 488/972] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 17 14:51:31 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:51:35.188719 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=2 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:51:35.783131 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b2b72-5e04-4553-8329-27cadfbb94e6 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:35.783569 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b2b72-5e04-4553-8329-27cadfbb94e6 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:35.783983 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b2b72-5e04-4553-8329-27cadfbb94e6 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:35.785575 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 485/973] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 17 14:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:35.790729 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0aaef-517a-4242-b307-e15d63005ec1 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:35.791253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0aaef-517a-4242-b307-e15d63005ec1 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:35.791483 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0aaef-517a-4242-b307-e15d63005ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:35.812771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-88c0aaef-517a-4242-b307-e15d63005ec1 None None] MFA Rules not processed for user `ff30f486b0964765bef7665e2b2a9e35`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:35.814052 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-88c0aaef-517a-4242-b307-e15d63005ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:35.823833 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 489/974] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 17 14:51:35 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:51:37.333235 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718beecd-872a-4669-95e3-6c06b3ec2626 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:37.333757 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718beecd-872a-4669-95e3-6c06b3ec2626 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:37.333996 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718beecd-872a-4669-95e3-6c06b3ec2626 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:37.335318 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 486/975] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 17 14:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:37.340693 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aee71-bb8d-4eca-80a8-ab15e1fe3817 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:37.341111 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aee71-bb8d-4eca-80a8-ab15e1fe3817 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:37.341306 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aee71-bb8d-4eca-80a8-ab15e1fe3817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:37.360779 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-a69aee71-bb8d-4eca-80a8-ab15e1fe3817 None None] MFA Rules not processed for user `ff30f486b0964765bef7665e2b2a9e35`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:37.362685 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-a69aee71-bb8d-4eca-80a8-ab15e1fe3817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:37.371437 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 490/976] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 17 14:51:37 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:51:41.319248 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f90ac-0d2f-4feb-88eb-7c2fd43e08df None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:41.319743 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f90ac-0d2f-4feb-88eb-7c2fd43e08df None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:41.319826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f90ac-0d2f-4feb-88eb-7c2fd43e08df None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:41.321223 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 487/977] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:41.326872 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ae4b8-bffa-466d-82ca-c82167f1fd23 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:41.327900 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ae4b8-bffa-466d-82ca-c82167f1fd23 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:41.328177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ae4b8-bffa-466d-82ca-c82167f1fd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:41.371834 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-482ae4b8-bffa-466d-82ca-c82167f1fd23 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:41.374805 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-482ae4b8-bffa-466d-82ca-c82167f1fd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:41.393914 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 491/978] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:51:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:51:41.751738 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd6191-2948-4d6d-a880-38932ec8e9a1 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:41.752267 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd6191-2948-4d6d-a880-38932ec8e9a1 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:41.752760 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd6191-2948-4d6d-a880-38932ec8e9a1 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:41.754814 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 488/979] 10.222.0.30 () {54 vars in 962 bytes} [Wed Aug 17 14:51:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:41.767709 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80635f3f-aa64-416a-b453-fbf379323ace None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:41.768409 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80635f3f-aa64-416a-b453-fbf379323ace None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:41.768901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80635f3f-aa64-416a-b453-fbf379323ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:41.814411 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-80635f3f-aa64-416a-b453-fbf379323ace None None] MFA Rules not processed for user `8aca6a001d3b479bab684772768d49f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:41.816061 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-80635f3f-aa64-416a-b453-fbf379323ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:41.889576 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:51:41.899332 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 492/980] 10.222.0.30 () {58 vars in 1059 bytes} [Wed Aug 17 14:51:41 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:51:41.907254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd6191-2948-4d6d-a880-38932ec8e9a1 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:51:41.921574 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd6191-2948-4d6d-a880-38932ec8e9a1 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:51:41.927426 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02912a-48a1-48e9-bcea-2399f8e6c6c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:51:41.928345 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02912a-48a1-48e9-bcea-2399f8e6c6c8 service nova] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:41.928854 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02912a-48a1-48e9-bcea-2399f8e6c6c8 service nova] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:41.929327 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02912a-48a1-48e9-bcea-2399f8e6c6c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:41.938425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02912a-48a1-48e9-bcea-2399f8e6c6c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:51:41.940701 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02912a-48a1-48e9-bcea-2399f8e6c6c8 service nova] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:51:41.951287 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 489/981] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:51:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:51:44.391376 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3952a-466c-4dad-9155-95f0781be1f9 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:44.391858 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3952a-466c-4dad-9155-95f0781be1f9 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:44.391999 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3952a-466c-4dad-9155-95f0781be1f9 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:44.393452 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 493/982] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:44.398944 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efb41e-0220-4ca3-9566-8414ffabc59a None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:44.399423 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efb41e-0220-4ca3-9566-8414ffabc59a None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:44.399506 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efb41e-0220-4ca3-9566-8414ffabc59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:44.418813 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-a9efb41e-0220-4ca3-9566-8414ffabc59a None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:44.419989 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-a9efb41e-0220-4ca3-9566-8414ffabc59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:44.428665 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 490/983] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:51:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:51:44.787304 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3952a-466c-4dad-9155-95f0781be1f9 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:51:44.801804 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3952a-466c-4dad-9155-95f0781be1f9 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:51:44.806742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac509d-c308-4828-aa71-61f86c19a9bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:51:44.807331 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac509d-c308-4828-aa71-61f86c19a9bb service nova] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:44.807785 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac509d-c308-4828-aa71-61f86c19a9bb service nova] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:44.808065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac509d-c308-4828-aa71-61f86c19a9bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:44.816677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac509d-c308-4828-aa71-61f86c19a9bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:51:44.818290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac509d-c308-4828-aa71-61f86c19a9bb service nova] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:51:44.827951 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 494/984] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:51:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:51:47.372994 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee89425-d46f-4059-8d8c-2bfb63547158 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:47.373543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee89425-d46f-4059-8d8c-2bfb63547158 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:47.373543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee89425-d46f-4059-8d8c-2bfb63547158 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:47.374903 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 491/985] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:47.380057 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa85f3b-90bb-4c5f-8b88-806b3143bf2e None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:47.380460 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa85f3b-90bb-4c5f-8b88-806b3143bf2e None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:47.380603 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa85f3b-90bb-4c5f-8b88-806b3143bf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:47.400024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-eaa85f3b-90bb-4c5f-8b88-806b3143bf2e None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:47.401244 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-eaa85f3b-90bb-4c5f-8b88-806b3143bf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:47.409649 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 495/986] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:51:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:51:47.765704 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb2859-73b5-4a3d-abfc-5da24bd49fbd None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:47.766061 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb2859-73b5-4a3d-abfc-5da24bd49fbd None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:47.766335 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb2859-73b5-4a3d-abfc-5da24bd49fbd None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:47.768608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 492/987] 10.222.0.30 () {54 vars in 962 bytes} [Wed Aug 17 14:51:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:47.775316 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e83f1d-842b-46ac-b70a-be6b62b08459 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:47.775610 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e83f1d-842b-46ac-b70a-be6b62b08459 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:47.775857 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e83f1d-842b-46ac-b70a-be6b62b08459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:47.801855 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-67e83f1d-842b-46ac-b70a-be6b62b08459 None None] MFA Rules not processed for user `8aca6a001d3b479bab684772768d49f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:47.803043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-67e83f1d-842b-46ac-b70a-be6b62b08459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:47.813127 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 496/988] 10.222.0.30 () {58 vars in 1059 bytes} [Wed Aug 17 14:51:47 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:51:47.821636 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb2859-73b5-4a3d-abfc-5da24bd49fbd None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:51:47.839615 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb2859-73b5-4a3d-abfc-5da24bd49fbd None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:51:47.846467 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb798d-35ff-43bb-a02b-7fbc6903294d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:51:47.847059 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb798d-35ff-43bb-a02b-7fbc6903294d service nova] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:47.847331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb798d-35ff-43bb-a02b-7fbc6903294d service nova] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:47.847599 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb798d-35ff-43bb-a02b-7fbc6903294d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:47.856300 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb798d-35ff-43bb-a02b-7fbc6903294d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:51:47.858130 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb798d-35ff-43bb-a02b-7fbc6903294d service nova] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:51:47.869184 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 493/989] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:51:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:51:50.271306 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cb54e-56d5-4c5a-a457-345bc835994b None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:50.272347 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cb54e-56d5-4c5a-a457-345bc835994b None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:50.272852 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cb54e-56d5-4c5a-a457-345bc835994b None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:50.279677 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72a296-a412-482e-abc2-fce080dc1893 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:50.280544 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72a296-a412-482e-abc2-fce080dc1893 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:50.281031 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72a296-a412-482e-abc2-fce080dc1893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:50.284280 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 497/990] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:51:50 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:50.302534 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-3b72a296-a412-482e-abc2-fce080dc1893 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:50.304087 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-3b72a296-a412-482e-abc2-fce080dc1893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:50.318072 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 494/991] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:51:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:51:50.672729 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cb54e-56d5-4c5a-a457-345bc835994b None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:51:50.692961 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cb54e-56d5-4c5a-a457-345bc835994b None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:51:50.698719 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e0f4c-9da3-43b2-9363-a6967299506b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:51:50.699560 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e0f4c-9da3-43b2-9363-a6967299506b service nova] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:50.700073 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e0f4c-9da3-43b2-9363-a6967299506b service nova] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:50.700574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e0f4c-9da3-43b2-9363-a6967299506b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:50.711026 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e0f4c-9da3-43b2-9363-a6967299506b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:51:50.713252 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e0f4c-9da3-43b2-9363-a6967299506b service nova] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:51:50.737107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 498/992] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:51:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:51:51.850656 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b739bd-d52d-47fd-b962-7a00e90c2b11 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:51.851096 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b739bd-d52d-47fd-b962-7a00e90c2b11 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:51.851187 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b739bd-d52d-47fd-b962-7a00e90c2b11 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:51.856332 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 495/993] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:51:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:51.857859 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee137c-ba30-41ac-a86c-cb28709e0a51 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:51.858843 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee137c-ba30-41ac-a86c-cb28709e0a51 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:51.859814 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee137c-ba30-41ac-a86c-cb28709e0a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:51.900417 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-6bee137c-ba30-41ac-a86c-cb28709e0a51 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:51.902039 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-6bee137c-ba30-41ac-a86c-cb28709e0a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:51.911255 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 499/994] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:51:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:51:52.531954 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aed12a-0867-4038-87c5-e369790839d6 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:52.531954 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aed12a-0867-4038-87c5-e369790839d6 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:52.531954 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aed12a-0867-4038-87c5-e369790839d6 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:52.534210 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 496/995] 10.222.0.30 () {54 vars in 964 bytes} [Wed Aug 17 14:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:52.538485 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a841ed-306c-4ec9-8083-e6721b93fa6d None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:52.538774 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a841ed-306c-4ec9-8083-e6721b93fa6d None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:52.539049 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a841ed-306c-4ec9-8083-e6721b93fa6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:52.583907 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-d0a841ed-306c-4ec9-8083-e6721b93fa6d None None] MFA Rules not processed for user `1dacf10fc91547788a9f8bbedfa0f553`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:52.585211 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-d0a841ed-306c-4ec9-8083-e6721b93fa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:52.649567 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 500/996] 10.222.0.30 () {58 vars in 1061 bytes} [Wed Aug 17 14:51:52 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:51:52.657002 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aed12a-0867-4038-87c5-e369790839d6 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:51:52.669536 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aed12a-0867-4038-87c5-e369790839d6 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:51:52.673900 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805f904-6bfa-4d61-b646-1e3b7d8ccc8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacf10fc91547788a9f8bbedfa0f553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:51:52.674662 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805f904-6bfa-4d61-b646-1e3b7d8ccc8b service cinder] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:52.675107 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805f904-6bfa-4d61-b646-1e3b7d8ccc8b service cinder] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:52.675521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805f904-6bfa-4d61-b646-1e3b7d8ccc8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:52.685581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805f904-6bfa-4d61-b646-1e3b7d8ccc8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:51:52.687298 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805f904-6bfa-4d61-b646-1e3b7d8ccc8b service cinder] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:51:52.698822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 497/997] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:51:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:51:53.184180 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9c179-436d-4067-88f4-a7dc7f39fa53 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:53.185016 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9c179-436d-4067-88f4-a7dc7f39fa53 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:53.185297 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9c179-436d-4067-88f4-a7dc7f39fa53 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:53.186648 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 501/998] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:51:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:53.192241 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781b57c-f2cf-4c40-8071-f8b8df02a26e None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:53.192666 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781b57c-f2cf-4c40-8071-f8b8df02a26e None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:53.192783 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781b57c-f2cf-4c40-8071-f8b8df02a26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:53.212626 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-2781b57c-f2cf-4c40-8071-f8b8df02a26e None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:53.213837 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-2781b57c-f2cf-4c40-8071-f8b8df02a26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:53.222658 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 498/999] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:51:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:51:53.583361 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9c179-436d-4067-88f4-a7dc7f39fa53 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:51:53.599096 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9c179-436d-4067-88f4-a7dc7f39fa53 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:51:53.604193 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fa828-5fdb-4a29-bdf7-1b6195e5fe8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:51:53.604785 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fa828-5fdb-4a29-bdf7-1b6195e5fe8b service nova] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:53.605070 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fa828-5fdb-4a29-bdf7-1b6195e5fe8b service nova] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:53.605417 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fa828-5fdb-4a29-bdf7-1b6195e5fe8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:53.616263 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fa828-5fdb-4a29-bdf7-1b6195e5fe8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:51:53.617916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fa828-5fdb-4a29-bdf7-1b6195e5fe8b service nova] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:51:53.633465 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 502/1000] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:51:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:51:55.935279 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32877d-7c17-4c71-b87d-8107c5058e77 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:55.935811 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32877d-7c17-4c71-b87d-8107c5058e77 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:55.935811 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32877d-7c17-4c71-b87d-8107c5058e77 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:55.937060 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 499/1001] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:51:55.942342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ef0bc-9d0f-4f76-abbd-09ea6846fe1c None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:55.943095 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ef0bc-9d0f-4f76-abbd-09ea6846fe1c None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:55.943371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ef0bc-9d0f-4f76-abbd-09ea6846fe1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:55.962296 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-751ef0bc-9d0f-4f76-abbd-09ea6846fe1c None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:55.963482 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-751ef0bc-9d0f-4f76-abbd-09ea6846fe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:55.977901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 503/1002] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:51:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:51:56.332989 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32877d-7c17-4c71-b87d-8107c5058e77 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:51:56.346840 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32877d-7c17-4c71-b87d-8107c5058e77 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:51:56.351691 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8b85c-2ce1-446a-af7b-d9f934761935 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:51:56.352274 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8b85c-2ce1-446a-af7b-d9f934761935 service nova] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:56.352550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8b85c-2ce1-446a-af7b-d9f934761935 service nova] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:56.352821 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8b85c-2ce1-446a-af7b-d9f934761935 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:56.361055 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8b85c-2ce1-446a-af7b-d9f934761935 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:51:56.362653 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8b85c-2ce1-446a-af7b-d9f934761935 service nova] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:51:56.372177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 500/1003] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:51:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:51:58.644809 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d36d8-b425-4729-bd8d-ef46042e12a1 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:58.645419 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d36d8-b425-4729-bd8d-ef46042e12a1 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:58.645419 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d36d8-b425-4729-bd8d-ef46042e12a1 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:58.647102 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 504/1004] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:51:58.654807 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cec902-151a-4a1c-b0c7-34adf369f05b None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:58.655946 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cec902-151a-4a1c-b0c7-34adf369f05b None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:58.655946 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cec902-151a-4a1c-b0c7-34adf369f05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:58.680782 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-c6cec902-151a-4a1c-b0c7-34adf369f05b None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:51:58.681983 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-c6cec902-151a-4a1c-b0c7-34adf369f05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:51:58.695361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 501/1005] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:51:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:51:59.058919 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d36d8-b425-4729-bd8d-ef46042e12a1 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:51:59.075947 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d36d8-b425-4729-bd8d-ef46042e12a1 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:51:59.082603 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c7581-c2cd-42c8-b8a7-b71ee9d9a3e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:51:59.083283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c7581-c2cd-42c8-b8a7-b71ee9d9a3e9 service nova] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:51:59.083436 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c7581-c2cd-42c8-b8a7-b71ee9d9a3e9 service nova] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:51:59.083730 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c7581-c2cd-42c8-b8a7-b71ee9d9a3e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:51:59.094237 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c7581-c2cd-42c8-b8a7-b71ee9d9a3e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:51:59.095864 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c7581-c2cd-42c8-b8a7-b71ee9d9a3e9 service nova] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:51:59.106445 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 505/1006] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:51:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:01.351776 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37427e63-4040-45e7-8705-e5945ee24a67 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:01.352340 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37427e63-4040-45e7-8705-e5945ee24a67 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:01.352340 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37427e63-4040-45e7-8705-e5945ee24a67 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:01.353758 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 502/1007] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:01.359090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb667bce-798f-4dc7-b1c0-3742ca69ce89 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:01.359487 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb667bce-798f-4dc7-b1c0-3742ca69ce89 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:01.359637 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb667bce-798f-4dc7-b1c0-3742ca69ce89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:01.381420 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-bb667bce-798f-4dc7-b1c0-3742ca69ce89 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:01.383203 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-bb667bce-798f-4dc7-b1c0-3742ca69ce89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:01.392135 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 506/1008] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:52:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:01.742218 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37427e63-4040-45e7-8705-e5945ee24a67 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:01.756411 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37427e63-4040-45e7-8705-e5945ee24a67 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:01.761257 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d120e3d-ad26-4a15-bed3-67dafe57ae87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:01.761907 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d120e3d-ad26-4a15-bed3-67dafe57ae87 service nova] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:01.762186 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d120e3d-ad26-4a15-bed3-67dafe57ae87 service nova] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:01.762462 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d120e3d-ad26-4a15-bed3-67dafe57ae87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:01.771999 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d120e3d-ad26-4a15-bed3-67dafe57ae87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:01.773568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d120e3d-ad26-4a15-bed3-67dafe57ae87 service nova] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:01.783346 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 503/1009] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:04.181838 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f1f1d-a7aa-4bc9-80b2-231af749b25e None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:04.182962 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f1f1d-a7aa-4bc9-80b2-231af749b25e None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:04.182962 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f1f1d-a7aa-4bc9-80b2-231af749b25e None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:04.184454 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 507/1010] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:52:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:04.190560 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792168e1-2740-4323-91b0-0d6cb0d3ec44 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:04.191059 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792168e1-2740-4323-91b0-0d6cb0d3ec44 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:04.191166 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792168e1-2740-4323-91b0-0d6cb0d3ec44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:04.211787 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-792168e1-2740-4323-91b0-0d6cb0d3ec44 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:04.212989 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-792168e1-2740-4323-91b0-0d6cb0d3ec44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:04.221473 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 504/1011] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:52:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:04.587556 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f1f1d-a7aa-4bc9-80b2-231af749b25e None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:04.608203 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f1f1d-a7aa-4bc9-80b2-231af749b25e None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:04.615998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d200f-a55e-4bc7-8bf6-3c5d3700fb13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:04.616862 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d200f-a55e-4bc7-8bf6-3c5d3700fb13 service nova] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:04.617253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d200f-a55e-4bc7-8bf6-3c5d3700fb13 service nova] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:04.617720 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d200f-a55e-4bc7-8bf6-3c5d3700fb13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:04.634140 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d200f-a55e-4bc7-8bf6-3c5d3700fb13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:04.636351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d200f-a55e-4bc7-8bf6-3c5d3700fb13 service nova] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:04.650407 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 508/1012] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:07.527434 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e2d3a-3b65-4a5a-b5fe-93ce3cbee9ce None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:07.528146 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e2d3a-3b65-4a5a-b5fe-93ce3cbee9ce None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:07.528146 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e2d3a-3b65-4a5a-b5fe-93ce3cbee9ce None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:07.529305 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 505/1013] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:07.535073 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d880d5d-47b5-46e9-87b2-b1df097d5232 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:07.535526 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d880d5d-47b5-46e9-87b2-b1df097d5232 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:07.535696 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d880d5d-47b5-46e9-87b2-b1df097d5232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:07.558074 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-0d880d5d-47b5-46e9-87b2-b1df097d5232 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:07.559316 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-0d880d5d-47b5-46e9-87b2-b1df097d5232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:07.567731 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 509/1014] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:52:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:07.914976 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e2d3a-3b65-4a5a-b5fe-93ce3cbee9ce None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:07.922451 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=46 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:52:07.929504 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e2d3a-3b65-4a5a-b5fe-93ce3cbee9ce None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:07.934446 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b703ff-c4a5-4a2f-a843-c6d74b611759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:07.935029 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b703ff-c4a5-4a2f-a843-c6d74b611759 service nova] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:07.935303 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b703ff-c4a5-4a2f-a843-c6d74b611759 service nova] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:07.935698 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b703ff-c4a5-4a2f-a843-c6d74b611759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:07.944819 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b703ff-c4a5-4a2f-a843-c6d74b611759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:07.946411 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b703ff-c4a5-4a2f-a843-c6d74b611759 service nova] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:07.957425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 506/1015] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:09.064223 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af845925-7acb-45c5-85da-eaf82d1e8641 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:09.064774 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af845925-7acb-45c5-85da-eaf82d1e8641 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:09.064774 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af845925-7acb-45c5-85da-eaf82d1e8641 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:09.066521 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 510/1016] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:09.071868 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681ecee-27c2-4d97-8e1a-a67dc7f01cfc None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:09.072318 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681ecee-27c2-4d97-8e1a-a67dc7f01cfc None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:09.072423 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681ecee-27c2-4d97-8e1a-a67dc7f01cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:09.093207 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-c681ecee-27c2-4d97-8e1a-a67dc7f01cfc None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:09.095185 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-c681ecee-27c2-4d97-8e1a-a67dc7f01cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:09.103518 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 507/1017] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:52:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:09.477949 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2731ded-0aa0-4458-a29d-85dde0f86013 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:09.478229 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2731ded-0aa0-4458-a29d-85dde0f86013 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:09.478500 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2731ded-0aa0-4458-a29d-85dde0f86013 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:09.479801 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 511/1018] 10.222.0.30 () {54 vars in 967 bytes} [Wed Aug 17 14:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:09.486130 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eee6a-b730-4978-b61b-6c33d2a2a923 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:09.486419 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eee6a-b730-4978-b61b-6c33d2a2a923 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:09.486792 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eee6a-b730-4978-b61b-6c33d2a2a923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:09.536649 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-b74eee6a-b730-4978-b61b-6c33d2a2a923 None None] MFA Rules not processed for user `272278199c5149a1ad326f22ef11f4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:09.539210 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-b74eee6a-b730-4978-b61b-6c33d2a2a923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:09.616434 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 508/1019] 10.222.0.30 () {58 vars in 1064 bytes} [Wed Aug 17 14:52:09 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:09.624798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2731ded-0aa0-4458-a29d-85dde0f86013 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:09.638761 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2731ded-0aa0-4458-a29d-85dde0f86013 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:09.643894 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c4b60-52d3-4a8f-baee-0512a1ae2f94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272278199c5149a1ad326f22ef11f4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:09.644821 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c4b60-52d3-4a8f-baee-0512a1ae2f94 service glance] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:09.645269 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c4b60-52d3-4a8f-baee-0512a1ae2f94 service glance] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:09.645701 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c4b60-52d3-4a8f-baee-0512a1ae2f94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:09.657232 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c4b60-52d3-4a8f-baee-0512a1ae2f94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:09.658772 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c4b60-52d3-4a8f-baee-0512a1ae2f94 service glance] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:09.669039 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 512/1020] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:10.258353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b5463-337e-44aa-a14e-e7444481a7cd None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:10.258978 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b5463-337e-44aa-a14e-e7444481a7cd None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:10.258978 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b5463-337e-44aa-a14e-e7444481a7cd None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:10.260432 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 509/1021] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:10.265973 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33773661-d387-40f9-921e-09ee81f490aa None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:10.266480 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33773661-d387-40f9-921e-09ee81f490aa None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:10.266574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33773661-d387-40f9-921e-09ee81f490aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:10.285821 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-33773661-d387-40f9-921e-09ee81f490aa None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:10.286999 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-33773661-d387-40f9-921e-09ee81f490aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:10.294872 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 513/1022] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:52:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:52:10.652519 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b5463-337e-44aa-a14e-e7444481a7cd None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:10.671889 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b5463-337e-44aa-a14e-e7444481a7cd None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:10.680720 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc7c28-4e27-40a9-927b-0b65fdc411d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:10.681335 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc7c28-4e27-40a9-927b-0b65fdc411d1 service nova] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:10.681609 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc7c28-4e27-40a9-927b-0b65fdc411d1 service nova] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:10.681914 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc7c28-4e27-40a9-927b-0b65fdc411d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:10.691572 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc7c28-4e27-40a9-927b-0b65fdc411d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:10.693147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc7c28-4e27-40a9-927b-0b65fdc411d1 service nova] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:10.705608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 510/1023] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:12.982934 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f50ee-cc13-47a5-84e6-01f0b9dee145 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:12.983608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f50ee-cc13-47a5-84e6-01f0b9dee145 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:12.983608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f50ee-cc13-47a5-84e6-01f0b9dee145 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:12.985779 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 514/1024] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:12.991338 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f898b22-1f17-4a93-bc60-b4d3fbfd5a03 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:12.991833 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f898b22-1f17-4a93-bc60-b4d3fbfd5a03 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:12.991937 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f898b22-1f17-4a93-bc60-b4d3fbfd5a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:13.015715 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-4f898b22-1f17-4a93-bc60-b4d3fbfd5a03 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:13.017123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-4f898b22-1f17-4a93-bc60-b4d3fbfd5a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:13.026589 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 511/1025] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:52:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:13.376043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f50ee-cc13-47a5-84e6-01f0b9dee145 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:13.383966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=92 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:52:13.391776 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f50ee-cc13-47a5-84e6-01f0b9dee145 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:13.397681 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc2ab7-b0ee-4ee7-8829-969c637920e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:13.398315 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc2ab7-b0ee-4ee7-8829-969c637920e2 service nova] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:13.398594 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc2ab7-b0ee-4ee7-8829-969c637920e2 service nova] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:13.398867 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc2ab7-b0ee-4ee7-8829-969c637920e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:13.409201 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc2ab7-b0ee-4ee7-8829-969c637920e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:13.410164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc2ab7-b0ee-4ee7-8829-969c637920e2 service nova] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:13.420234 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 515/1026] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:23.010772 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=50 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:52:23.415952 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=5 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:52:24.982119 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774c00c-09ec-4a1f-a30c-3e59f11fd39f None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:24.982754 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774c00c-09ec-4a1f-a30c-3e59f11fd39f None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:24.982754 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774c00c-09ec-4a1f-a30c-3e59f11fd39f None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:24.983985 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 512/1027] 10.222.0.30 () {54 vars in 918 bytes} [Wed Aug 17 14:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:24.989626 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa0510-9215-4efa-a08c-923ebfa4b695 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:24.990119 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa0510-9215-4efa-a08c-923ebfa4b695 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:24.990233 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa0510-9215-4efa-a08c-923ebfa4b695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:25.009835 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-39aa0510-9215-4efa-a08c-923ebfa4b695 None None] MFA Rules not processed for user `ff30f486b0964765bef7665e2b2a9e35`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:25.011019 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-39aa0510-9215-4efa-a08c-923ebfa4b695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:25.020105 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 516/1028] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Aug 17 14:52:24 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:25.034544 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25667109-63a5-40ba-b1e7-de09efdd8fb3 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:25.034825 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25667109-63a5-40ba-b1e7-de09efdd8fb3 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:25.035098 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25667109-63a5-40ba-b1e7-de09efdd8fb3 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:25.036394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 513/1029] 10.222.0.30 () {54 vars in 918 bytes} [Wed Aug 17 14:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:25.040696 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d733e2-d303-4fb0-a882-84b467499983 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:25.040979 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d733e2-d303-4fb0-a882-84b467499983 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:25.041252 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d733e2-d303-4fb0-a882-84b467499983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:25.060843 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-02d733e2-d303-4fb0-a882-84b467499983 None None] MFA Rules not processed for user `8aca6a001d3b479bab684772768d49f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:25.062075 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-02d733e2-d303-4fb0-a882-84b467499983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:25.071447 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 517/1030] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Aug 17 14:52:25 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:27.766304 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b714c-0d3f-4d8e-bce9-bfcd639b2958 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:27.766917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b714c-0d3f-4d8e-bce9-bfcd639b2958 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:27.766917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b714c-0d3f-4d8e-bce9-bfcd639b2958 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:27.768174 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 514/1031] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:27.773419 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d8ef4-212b-45f6-979f-75ba41433f98 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:27.773892 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d8ef4-212b-45f6-979f-75ba41433f98 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:27.773992 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d8ef4-212b-45f6-979f-75ba41433f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:27.793601 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-581d8ef4-212b-45f6-979f-75ba41433f98 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:27.794840 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-581d8ef4-212b-45f6-979f-75ba41433f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:27.803581 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 518/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:52:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:28.154773 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b714c-0d3f-4d8e-bce9-bfcd639b2958 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:28.168551 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b714c-0d3f-4d8e-bce9-bfcd639b2958 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:28.174080 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae653ac-3012-4b88-bf2b-3f545d6e9ef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:28.174658 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae653ac-3012-4b88-bf2b-3f545d6e9ef5 service nova] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:28.174929 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae653ac-3012-4b88-bf2b-3f545d6e9ef5 service nova] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:28.175192 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae653ac-3012-4b88-bf2b-3f545d6e9ef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:28.183105 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae653ac-3012-4b88-bf2b-3f545d6e9ef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:28.184667 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae653ac-3012-4b88-bf2b-3f545d6e9ef5 service nova] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:28.193901 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 515/1033] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:29.146311 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc62e8-a49a-4fe4-8f56-f8d852b5d784 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:29.146872 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc62e8-a49a-4fe4-8f56-f8d852b5d784 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:29.146872 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc62e8-a49a-4fe4-8f56-f8d852b5d784 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:29.148161 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 519/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:29.153029 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec06bf8-e00d-416b-99d1-09f47939bc32 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:29.153531 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec06bf8-e00d-416b-99d1-09f47939bc32 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:29.153531 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec06bf8-e00d-416b-99d1-09f47939bc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:29.173326 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-aec06bf8-e00d-416b-99d1-09f47939bc32 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:29.174538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-aec06bf8-e00d-416b-99d1-09f47939bc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:29.182277 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 516/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:52:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:29.409801 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc62e8-a49a-4fe4-8f56-f8d852b5d784 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:29.423127 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc62e8-a49a-4fe4-8f56-f8d852b5d784 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:29.428038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c06c8-20a1-483c-a651-c4d8c6d43648 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:29.428619 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c06c8-20a1-483c-a651-c4d8c6d43648 service nova] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:29.428897 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c06c8-20a1-483c-a651-c4d8c6d43648 service nova] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:29.429167 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c06c8-20a1-483c-a651-c4d8c6d43648 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:29.437602 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c06c8-20a1-483c-a651-c4d8c6d43648 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:29.439468 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c06c8-20a1-483c-a651-c4d8c6d43648 service nova] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:29.448654 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 520/1036] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:30.355263 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9c3d1-4135-4fb6-9d4b-8197647349c8 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:30.355818 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9c3d1-4135-4fb6-9d4b-8197647349c8 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:30.355818 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9c3d1-4135-4fb6-9d4b-8197647349c8 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:30.357139 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 517/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:30.362231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737f743-2271-4d9c-a7c6-cc3a1ac48976 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:30.362668 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737f743-2271-4d9c-a7c6-cc3a1ac48976 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:30.362769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737f743-2271-4d9c-a7c6-cc3a1ac48976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:30.384677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-5737f743-2271-4d9c-a7c6-cc3a1ac48976 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:30.385899 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-5737f743-2271-4d9c-a7c6-cc3a1ac48976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:30.394213 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 521/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:52:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:30.548017 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9c3d1-4135-4fb6-9d4b-8197647349c8 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:30.564181 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9c3d1-4135-4fb6-9d4b-8197647349c8 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:30.569101 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e830fa8-aa84-48b4-8e65-84f37fa70ce8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:30.569690 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e830fa8-aa84-48b4-8e65-84f37fa70ce8 service nova] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:30.569999 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e830fa8-aa84-48b4-8e65-84f37fa70ce8 service nova] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:30.570269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e830fa8-aa84-48b4-8e65-84f37fa70ce8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:30.579057 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e830fa8-aa84-48b4-8e65-84f37fa70ce8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:30.580687 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e830fa8-aa84-48b4-8e65-84f37fa70ce8 service nova] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:30.589988 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 518/1039] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:31.470288 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb4458-14c4-478a-8f0b-b26b0b0d4d21 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:31.470926 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb4458-14c4-478a-8f0b-b26b0b0d4d21 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:31.470926 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb4458-14c4-478a-8f0b-b26b0b0d4d21 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:31.472223 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 522/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:31.476959 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec792f2-29de-45e3-9690-fb2efa7eff2c None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:31.477356 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec792f2-29de-45e3-9690-fb2efa7eff2c None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:31.477505 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec792f2-29de-45e3-9690-fb2efa7eff2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:31.497596 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-7ec792f2-29de-45e3-9690-fb2efa7eff2c None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:31.498822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-7ec792f2-29de-45e3-9690-fb2efa7eff2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:31.507317 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 519/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:52:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:31.661799 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb4458-14c4-478a-8f0b-b26b0b0d4d21 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:31.675634 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb4458-14c4-478a-8f0b-b26b0b0d4d21 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:31.680436 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974dcbd-7ce8-4455-a771-2ef7b202057c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:31.681012 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974dcbd-7ce8-4455-a771-2ef7b202057c service nova] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:31.681286 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974dcbd-7ce8-4455-a771-2ef7b202057c service nova] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:31.681551 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974dcbd-7ce8-4455-a771-2ef7b202057c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:31.690512 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974dcbd-7ce8-4455-a771-2ef7b202057c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:31.692108 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974dcbd-7ce8-4455-a771-2ef7b202057c service nova] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:31.701844 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 523/1042] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:32.563227 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db24e87-959c-403c-bc78-849ee4c1c79c None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:32.563697 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db24e87-959c-403c-bc78-849ee4c1c79c None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:32.563794 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db24e87-959c-403c-bc78-849ee4c1c79c None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:32.565101 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 520/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:52:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:32.569940 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a504abe-f2ca-4832-8652-18ce99194492 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:32.570385 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a504abe-f2ca-4832-8652-18ce99194492 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:32.570503 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a504abe-f2ca-4832-8652-18ce99194492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:32.590284 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-6a504abe-f2ca-4832-8652-18ce99194492 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:32.591481 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-6a504abe-f2ca-4832-8652-18ce99194492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:32.599579 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 524/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:52:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:32.760318 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db24e87-959c-403c-bc78-849ee4c1c79c None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:32.774454 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db24e87-959c-403c-bc78-849ee4c1c79c None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:32.779379 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d129612-a3fd-44a8-bb3b-05d9992051c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:32.779953 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d129612-a3fd-44a8-bb3b-05d9992051c9 service nova] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:32.780232 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d129612-a3fd-44a8-bb3b-05d9992051c9 service nova] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:32.780498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d129612-a3fd-44a8-bb3b-05d9992051c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:32.790582 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d129612-a3fd-44a8-bb3b-05d9992051c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:32.792153 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d129612-a3fd-44a8-bb3b-05d9992051c9 service nova] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:32.804174 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 521/1045] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:33.615246 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98d5e0-706e-4b61-9145-09e6631836ed None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:33.615757 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98d5e0-706e-4b61-9145-09e6631836ed None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:33.615843 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98d5e0-706e-4b61-9145-09e6631836ed None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:33.617135 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 525/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:33.622408 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92dc18-0772-41f8-9413-c6b9ecaf1417 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:33.622810 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92dc18-0772-41f8-9413-c6b9ecaf1417 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:33.622953 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92dc18-0772-41f8-9413-c6b9ecaf1417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:33.647719 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-3b92dc18-0772-41f8-9413-c6b9ecaf1417 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:33.649291 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-3b92dc18-0772-41f8-9413-c6b9ecaf1417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:33.658290 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 522/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:52:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:33.811678 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98d5e0-706e-4b61-9145-09e6631836ed None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:33.825380 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98d5e0-706e-4b61-9145-09e6631836ed None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:33.830295 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993e1bb-3cb1-436a-918b-baa992651dbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:33.830882 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993e1bb-3cb1-436a-918b-baa992651dbb service nova] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:33.831155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993e1bb-3cb1-436a-918b-baa992651dbb service nova] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:33.831421 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993e1bb-3cb1-436a-918b-baa992651dbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:33.839262 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993e1bb-3cb1-436a-918b-baa992651dbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:33.840815 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993e1bb-3cb1-436a-918b-baa992651dbb service nova] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:33.850444 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 526/1048] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:34.659092 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebe32d-6a7a-4007-824f-17dc4d516d1f None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:34.659654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebe32d-6a7a-4007-824f-17dc4d516d1f None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:34.659654 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebe32d-6a7a-4007-824f-17dc4d516d1f None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:34.660968 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 523/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:34.665911 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12418244-ad32-4303-87a6-b05b077b2863 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:34.666337 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12418244-ad32-4303-87a6-b05b077b2863 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:34.666461 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12418244-ad32-4303-87a6-b05b077b2863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:34.686176 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-12418244-ad32-4303-87a6-b05b077b2863 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:34.688053 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-12418244-ad32-4303-87a6-b05b077b2863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:34.695954 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 527/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:52:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:34.852543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebe32d-6a7a-4007-824f-17dc4d516d1f None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:34.866558 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebe32d-6a7a-4007-824f-17dc4d516d1f None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:34.871645 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5477e-3252-4c06-9af7-d2b5745f949c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:34.872217 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5477e-3252-4c06-9af7-d2b5745f949c service nova] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:34.872492 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5477e-3252-4c06-9af7-d2b5745f949c service nova] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:34.872758 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5477e-3252-4c06-9af7-d2b5745f949c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:34.880904 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5477e-3252-4c06-9af7-d2b5745f949c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:34.882481 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5477e-3252-4c06-9af7-d2b5745f949c service nova] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:34.891747 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 524/1051] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:35.705244 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd223c20-a5df-4311-bbe3-9d870eb2a2ce None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:35.705801 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd223c20-a5df-4311-bbe3-9d870eb2a2ce None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:35.705801 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd223c20-a5df-4311-bbe3-9d870eb2a2ce None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:35.707111 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 528/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:35.711846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f073243-de2d-4095-9771-667ca034764e None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:35.712268 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f073243-de2d-4095-9771-667ca034764e None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:35.712399 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f073243-de2d-4095-9771-667ca034764e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:35.731499 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-9f073243-de2d-4095-9771-667ca034764e None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:35.732698 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-9f073243-de2d-4095-9771-667ca034764e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:35.740624 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 525/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:52:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:35.897442 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd223c20-a5df-4311-bbe3-9d870eb2a2ce None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:35.910885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd223c20-a5df-4311-bbe3-9d870eb2a2ce None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:35.915797 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccc473-f681-4bf4-9991-1204b784adfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:35.916382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccc473-f681-4bf4-9991-1204b784adfc service nova] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:35.916662 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccc473-f681-4bf4-9991-1204b784adfc service nova] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:35.916935 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccc473-f681-4bf4-9991-1204b784adfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:35.925496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccc473-f681-4bf4-9991-1204b784adfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:35.927104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccc473-f681-4bf4-9991-1204b784adfc service nova] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:35.936368 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 529/1054] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:36.744871 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8b6e3-4afc-4454-b805-34ce97f94640 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:36.745425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8b6e3-4afc-4454-b805-34ce97f94640 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:36.745425 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8b6e3-4afc-4454-b805-34ce97f94640 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:36.746791 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 526/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:36.752583 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc5726-58e3-42f2-a3aa-b7b8b15e3919 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:36.753065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc5726-58e3-42f2-a3aa-b7b8b15e3919 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:36.753201 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc5726-58e3-42f2-a3aa-b7b8b15e3919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:36.772350 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-bccc5726-58e3-42f2-a3aa-b7b8b15e3919 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:36.773524 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-bccc5726-58e3-42f2-a3aa-b7b8b15e3919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:36.781646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 530/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:52:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:36.938484 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8b6e3-4afc-4454-b805-34ce97f94640 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:36.951699 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8b6e3-4afc-4454-b805-34ce97f94640 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:36.957117 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9579b-efec-429a-8062-7dd0011e8afd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:36.957706 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9579b-efec-429a-8062-7dd0011e8afd service nova] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:36.958013 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9579b-efec-429a-8062-7dd0011e8afd service nova] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:36.958280 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9579b-efec-429a-8062-7dd0011e8afd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:36.966503 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9579b-efec-429a-8062-7dd0011e8afd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:36.968574 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9579b-efec-429a-8062-7dd0011e8afd service nova] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:36.977810 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 527/1057] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:39.041380 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afcbec-0362-4d58-9268-d71b54deb950 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:39.041887 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afcbec-0362-4d58-9268-d71b54deb950 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:39.042008 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afcbec-0362-4d58-9268-d71b54deb950 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:39.043313 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 531/1058] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:39.049297 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684e4db-1893-4e5e-b9ee-41f5c376e66a None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:39.049711 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684e4db-1893-4e5e-b9ee-41f5c376e66a None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:39.049879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684e4db-1893-4e5e-b9ee-41f5c376e66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:39.068681 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-c684e4db-1893-4e5e-b9ee-41f5c376e66a None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:39.069921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-c684e4db-1893-4e5e-b9ee-41f5c376e66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:39.080409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 528/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:52:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:39.419158 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afcbec-0362-4d58-9268-d71b54deb950 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:39.429994 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afcbec-0362-4d58-9268-d71b54deb950 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:39.433426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603263d-140a-47c6-8934-e170494d70f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:39.434030 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603263d-140a-47c6-8934-e170494d70f0 service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:39.434300 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603263d-140a-47c6-8934-e170494d70f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:39.434563 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603263d-140a-47c6-8934-e170494d70f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:39.443683 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603263d-140a-47c6-8934-e170494d70f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:39.445087 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603263d-140a-47c6-8934-e170494d70f0 service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:39.454856 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 532/1060] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:41.802003 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263af903-4026-48c5-ae96-e3eb0af0fcee None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:41.802576 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263af903-4026-48c5-ae96-e3eb0af0fcee None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:41.802576 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263af903-4026-48c5-ae96-e3eb0af0fcee None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:41.803926 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 529/1061] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:41.809095 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251152ca-21d8-40eb-8823-850dbe497720 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:41.809479 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251152ca-21d8-40eb-8823-850dbe497720 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:41.809638 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251152ca-21d8-40eb-8823-850dbe497720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:41.829102 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-251152ca-21d8-40eb-8823-850dbe497720 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:41.830320 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-251152ca-21d8-40eb-8823-850dbe497720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:41.838023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 533/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:52:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:42.191885 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263af903-4026-48c5-ae96-e3eb0af0fcee None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:42.202449 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263af903-4026-48c5-ae96-e3eb0af0fcee None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:42.205870 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe042c-3de0-41cc-89f0-3b0af5b2b6a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:42.206442 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe042c-3de0-41cc-89f0-3b0af5b2b6a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:42.206714 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe042c-3de0-41cc-89f0-3b0af5b2b6a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:42.206979 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe042c-3de0-41cc-89f0-3b0af5b2b6a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:42.215848 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe042c-3de0-41cc-89f0-3b0af5b2b6a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:42.217242 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe042c-3de0-41cc-89f0-3b0af5b2b6a9 service neutron] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:42.227128 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 530/1063] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:44.704005 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de1176-8611-4980-a818-1e36e740cc8f None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:44.704557 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de1176-8611-4980-a818-1e36e740cc8f None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:44.704557 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de1176-8611-4980-a818-1e36e740cc8f None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:44.705954 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 534/1064] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:44.711055 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b7c7a-ff76-4d72-9153-fe415073baf0 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:44.711452 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b7c7a-ff76-4d72-9153-fe415073baf0 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:44.711604 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b7c7a-ff76-4d72-9153-fe415073baf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:44.730599 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-828b7c7a-ff76-4d72-9153-fe415073baf0 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:44.731786 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-828b7c7a-ff76-4d72-9153-fe415073baf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:44.740183 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 531/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:52:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:45.085360 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de1176-8611-4980-a818-1e36e740cc8f None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:45.096837 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de1176-8611-4980-a818-1e36e740cc8f None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:45.100332 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac560b68-1068-4749-9f42-e7a99f5c4f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:45.100914 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac560b68-1068-4749-9f42-e7a99f5c4f30 service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:45.101194 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac560b68-1068-4749-9f42-e7a99f5c4f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:45.101470 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac560b68-1068-4749-9f42-e7a99f5c4f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:45.110565 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac560b68-1068-4749-9f42-e7a99f5c4f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:45.111987 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac560b68-1068-4749-9f42-e7a99f5c4f30 service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:45.121837 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 535/1066] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:47.477449 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0314aa-b461-48f3-b802-8c052d6a7ce5 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:47.477974 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0314aa-b461-48f3-b802-8c052d6a7ce5 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:47.478083 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0314aa-b461-48f3-b802-8c052d6a7ce5 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:47.479351 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 532/1067] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:47.485383 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b7574-b641-4bbd-8d68-960b62dfa3b8 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:47.485852 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b7574-b641-4bbd-8d68-960b62dfa3b8 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:47.485947 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b7574-b641-4bbd-8d68-960b62dfa3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:47.505058 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-206b7574-b641-4bbd-8d68-960b62dfa3b8 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:47.506290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-206b7574-b641-4bbd-8d68-960b62dfa3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:47.514083 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 536/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:52:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:47.854863 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0314aa-b461-48f3-b802-8c052d6a7ce5 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:47.866073 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0314aa-b461-48f3-b802-8c052d6a7ce5 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:47.869796 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749c154-74d8-4e10-ae5f-03b83b79b192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:47.870362 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749c154-74d8-4e10-ae5f-03b83b79b192 service neutron] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:47.870640 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749c154-74d8-4e10-ae5f-03b83b79b192 service neutron] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:47.870909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749c154-74d8-4e10-ae5f-03b83b79b192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:47.880647 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749c154-74d8-4e10-ae5f-03b83b79b192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:47.882129 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749c154-74d8-4e10-ae5f-03b83b79b192 service neutron] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:47.891335 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 533/1069] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:50.126280 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff6b20-c037-43f8-8a38-db830725d679 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:50.126810 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff6b20-c037-43f8-8a38-db830725d679 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:50.126810 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff6b20-c037-43f8-8a38-db830725d679 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:50.128119 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 537/1070] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:50.133314 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab5a40-0654-4f54-8a47-01fbb575be81 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:50.133775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab5a40-0654-4f54-8a47-01fbb575be81 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:50.133895 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab5a40-0654-4f54-8a47-01fbb575be81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:50.153199 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-52ab5a40-0654-4f54-8a47-01fbb575be81 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:50.154429 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-52ab5a40-0654-4f54-8a47-01fbb575be81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:50.162940 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 534/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:52:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:50.502453 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff6b20-c037-43f8-8a38-db830725d679 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:50.513021 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff6b20-c037-43f8-8a38-db830725d679 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:50.517448 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e8a5d-a6dd-4c91-bb8c-5f94a923c839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:50.518058 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e8a5d-a6dd-4c91-bb8c-5f94a923c839 service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:50.518334 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e8a5d-a6dd-4c91-bb8c-5f94a923c839 service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:50.518621 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e8a5d-a6dd-4c91-bb8c-5f94a923c839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:50.527300 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e8a5d-a6dd-4c91-bb8c-5f94a923c839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:50.528717 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e8a5d-a6dd-4c91-bb8c-5f94a923c839 service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:50.538484 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 538/1072] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:52.763451 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36170554-28a1-4d03-96c5-e32afc03a195 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:52.763980 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36170554-28a1-4d03-96c5-e32afc03a195 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:52.763980 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36170554-28a1-4d03-96c5-e32afc03a195 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:52.765367 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 535/1073] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:52.770579 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21edc60-b19c-4cf1-8264-a051671b2286 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:52.771000 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21edc60-b19c-4cf1-8264-a051671b2286 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:52.771117 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21edc60-b19c-4cf1-8264-a051671b2286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:52.790098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-e21edc60-b19c-4cf1-8264-a051671b2286 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:52.791270 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-e21edc60-b19c-4cf1-8264-a051671b2286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:52.799669 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 539/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:52:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:53.146731 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36170554-28a1-4d03-96c5-e32afc03a195 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:53.152088 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=64 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:52:53.158935 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36170554-28a1-4d03-96c5-e32afc03a195 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:53.162404 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a93d2-a4ca-4b18-93fc-3fb3ee088b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:53.162983 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a93d2-a4ca-4b18-93fc-3fb3ee088b39 service neutron] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:53.163258 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a93d2-a4ca-4b18-93fc-3fb3ee088b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:53.163527 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a93d2-a4ca-4b18-93fc-3fb3ee088b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:53.172426 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a93d2-a4ca-4b18-93fc-3fb3ee088b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:53.173879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a93d2-a4ca-4b18-93fc-3fb3ee088b39 service neutron] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:53.182963 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 536/1075] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:55.504617 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8373ea9-f256-47fe-850b-d281674f4e48 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:55.505256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8373ea9-f256-47fe-850b-d281674f4e48 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:55.505256 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8373ea9-f256-47fe-850b-d281674f4e48 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:55.506529 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 540/1076] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:52:55.511603 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e83f9-79e9-4a2a-8424-3fc2d21839fd None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:55.512057 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e83f9-79e9-4a2a-8424-3fc2d21839fd None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:55.512175 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e83f9-79e9-4a2a-8424-3fc2d21839fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:55.531739 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-af3e83f9-79e9-4a2a-8424-3fc2d21839fd None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:55.532927 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-af3e83f9-79e9-4a2a-8424-3fc2d21839fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:55.540577 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 537/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:52:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:55.891022 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8373ea9-f256-47fe-850b-d281674f4e48 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:55.896332 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=73 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:52:55.902617 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8373ea9-f256-47fe-850b-d281674f4e48 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:55.906609 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a8403-cc33-4ded-b2c3-7891f60088dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:55.907177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a8403-cc33-4ded-b2c3-7891f60088dc service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:55.907450 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a8403-cc33-4ded-b2c3-7891f60088dc service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:55.907716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a8403-cc33-4ded-b2c3-7891f60088dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:55.916382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a8403-cc33-4ded-b2c3-7891f60088dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:55.917823 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a8403-cc33-4ded-b2c3-7891f60088dc service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:55.927644 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 541/1078] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:52:58.155101 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21debd-86de-4fd9-974e-89d6a7d0febf None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:58.155818 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21debd-86de-4fd9-974e-89d6a7d0febf None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:58.155818 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21debd-86de-4fd9-974e-89d6a7d0febf None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:58.157063 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 538/1079] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:52:58.162209 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4b985-94f7-48f3-9815-48c852188ad1 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:58.162641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4b985-94f7-48f3-9815-48c852188ad1 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:58.162769 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4b985-94f7-48f3-9815-48c852188ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:58.181697 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-68c4b985-94f7-48f3-9815-48c852188ad1 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:52:58.183010 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-68c4b985-94f7-48f3-9815-48c852188ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:52:58.191423 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 542/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:52:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:52:58.537076 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21debd-86de-4fd9-974e-89d6a7d0febf None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:52:58.548388 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21debd-86de-4fd9-974e-89d6a7d0febf None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:52:58.551960 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eff9c3-fefd-4c53-9791-3963ef0586f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:52:58.552558 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eff9c3-fefd-4c53-9791-3963ef0586f4 service neutron] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:52:58.552971 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eff9c3-fefd-4c53-9791-3963ef0586f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:52:58.553260 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eff9c3-fefd-4c53-9791-3963ef0586f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:52:58.563743 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eff9c3-fefd-4c53-9791-3963ef0586f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:52:58.565159 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eff9c3-fefd-4c53-9791-3963ef0586f4 service neutron] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:52:58.574620 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 539/1081] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:52:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:53:00.788224 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2d0de-f6ea-44f3-ba5c-2af954694099 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:00.788780 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2d0de-f6ea-44f3-ba5c-2af954694099 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:00.788780 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2d0de-f6ea-44f3-ba5c-2af954694099 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:00.790095 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 543/1082] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:53:00.795786 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca619a-b207-4626-a709-81031c7d4084 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:00.796214 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca619a-b207-4626-a709-81031c7d4084 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:00.796331 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca619a-b207-4626-a709-81031c7d4084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:00.815482 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-a6ca619a-b207-4626-a709-81031c7d4084 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:53:00.816586 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-a6ca619a-b207-4626-a709-81031c7d4084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:53:00.824312 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 540/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:53:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:53:01.175413 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2d0de-f6ea-44f3-ba5c-2af954694099 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:53:01.186099 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2d0de-f6ea-44f3-ba5c-2af954694099 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:53:01.189893 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90594655-d803-4911-a43c-dc623a7f8a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:53:01.190549 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90594655-d803-4911-a43c-dc623a7f8a90 service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:01.190822 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90594655-d803-4911-a43c-dc623a7f8a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:01.191090 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90594655-d803-4911-a43c-dc623a7f8a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:01.199782 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90594655-d803-4911-a43c-dc623a7f8a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:53:01.201176 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90594655-d803-4911-a43c-dc623a7f8a90 service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:53:01.211065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 544/1084] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:53:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:53:03.407500 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a4224-6aad-44e3-9470-95617b46f24e None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:03.408027 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a4224-6aad-44e3-9470-95617b46f24e None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:03.408027 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a4224-6aad-44e3-9470-95617b46f24e None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:03.409341 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 541/1085] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:53:03.414666 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee17414-9580-41a9-b947-b4808cd860d2 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:03.415142 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee17414-9580-41a9-b947-b4808cd860d2 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:03.415247 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee17414-9580-41a9-b947-b4808cd860d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:03.433998 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-7ee17414-9580-41a9-b947-b4808cd860d2 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:53:03.435173 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-7ee17414-9580-41a9-b947-b4808cd860d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:53:03.443754 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 545/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:53:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:53:03.790512 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a4224-6aad-44e3-9470-95617b46f24e None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:53:03.801278 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a4224-6aad-44e3-9470-95617b46f24e None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:53:03.804762 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400fa45-77cc-4aa5-a358-e05f4aa6b474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:53:03.805342 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400fa45-77cc-4aa5-a358-e05f4aa6b474 service neutron] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:03.805621 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400fa45-77cc-4aa5-a358-e05f4aa6b474 service neutron] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:03.805923 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400fa45-77cc-4aa5-a358-e05f4aa6b474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:03.814764 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400fa45-77cc-4aa5-a358-e05f4aa6b474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:53:03.816169 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400fa45-77cc-4aa5-a358-e05f4aa6b474 service neutron] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:53:03.825525 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 542/1087] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:53:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:53:13.429340 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=17 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:53:13.821348 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=23 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:53:27.977141 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662426ce-21ab-49d1-a406-ca7156d18901 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:27.977758 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662426ce-21ab-49d1-a406-ca7156d18901 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:27.977758 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662426ce-21ab-49d1-a406-ca7156d18901 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:27.979027 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 546/1088] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:53:27.984656 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d318b-dc42-4b80-b98d-25aa9f5c520f None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:27.985118 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d318b-dc42-4b80-b98d-25aa9f5c520f None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:27.985250 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d318b-dc42-4b80-b98d-25aa9f5c520f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:28.004902 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-da0d318b-dc42-4b80-b98d-25aa9f5c520f None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:53:28.006128 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-da0d318b-dc42-4b80-b98d-25aa9f5c520f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:53:28.013856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 543/1089] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:53:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:53:28.378045 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb0ed2-d50c-4101-b0c6-4e0aad0c6fcd None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:28.378327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb0ed2-d50c-4101-b0c6-4e0aad0c6fcd None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:28.378598 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb0ed2-d50c-4101-b0c6-4e0aad0c6fcd None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:28.379897 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 547/1090] 10.222.0.30 () {54 vars in 967 bytes} [Wed Aug 17 14:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:53:28.384943 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3615b16-dfe6-4cb8-80b1-476ab0db6cfa None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:28.385228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3615b16-dfe6-4cb8-80b1-476ab0db6cfa None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:28.385503 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3615b16-dfe6-4cb8-80b1-476ab0db6cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:28.404444 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-c3615b16-dfe6-4cb8-80b1-476ab0db6cfa None None] MFA Rules not processed for user `272278199c5149a1ad326f22ef11f4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:53:28.405666 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-c3615b16-dfe6-4cb8-80b1-476ab0db6cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:53:28.412082 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 544/1091] 10.222.0.30 () {58 vars in 1064 bytes} [Wed Aug 17 14:53:28 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:53:28.419188 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb0ed2-d50c-4101-b0c6-4e0aad0c6fcd None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:53:28.430250 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb0ed2-d50c-4101-b0c6-4e0aad0c6fcd None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:53:28.433753 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28628323-7a87-4e45-96e6-f20d8cef4fdb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272278199c5149a1ad326f22ef11f4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:53:28.434335 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28628323-7a87-4e45-96e6-f20d8cef4fdb service glance] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:28.434611 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28628323-7a87-4e45-96e6-f20d8cef4fdb service glance] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:28.434879 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28628323-7a87-4e45-96e6-f20d8cef4fdb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:28.444205 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28628323-7a87-4e45-96e6-f20d8cef4fdb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:53:28.445608 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28628323-7a87-4e45-96e6-f20d8cef4fdb service glance] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:53:28.454982 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 548/1092] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:53:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:53:30.729927 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a22073-52ca-49e8-a9c5-d1479aed2887 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:30.730480 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a22073-52ca-49e8-a9c5-d1479aed2887 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:30.730480 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a22073-52ca-49e8-a9c5-d1479aed2887 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:30.731775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 545/1093] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:53:30.737591 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52ba7e-dda4-4e56-a9a5-4e5c31b1e6f3 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:30.738065 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52ba7e-dda4-4e56-a9a5-4e5c31b1e6f3 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:30.738174 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52ba7e-dda4-4e56-a9a5-4e5c31b1e6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:30.757916 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-4e52ba7e-dda4-4e56-a9a5-4e5c31b1e6f3 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:53:30.759091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-4e52ba7e-dda4-4e56-a9a5-4e5c31b1e6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:53:30.767011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 549/1094] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:53:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:53:31.101234 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a22073-52ca-49e8-a9c5-d1479aed2887 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:53:31.114544 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a22073-52ca-49e8-a9c5-d1479aed2887 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:53:31.119150 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01777e67-271e-454c-a07e-6c96ee1e27e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:53:31.119726 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01777e67-271e-454c-a07e-6c96ee1e27e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:31.120001 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01777e67-271e-454c-a07e-6c96ee1e27e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:31.120270 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01777e67-271e-454c-a07e-6c96ee1e27e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:31.120903 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01777e67-271e-454c-a07e-6c96ee1e27e5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:53:31.122677 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: WARNING py.warnings [None req-01777e67-271e-454c-a07e-6c96ee1e27e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:53:31.122677 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: warnings.warn(msg) Aug 17 14:53:31.122677 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: Aug 17 14:53:31.123795 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01777e67-271e-454c-a07e-6c96ee1e27e5 admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:53:31.142532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 546/1095] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Aug 17 14:53:31 2022] GET /identity/v3/projects => generated 1606 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:53:33.349239 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b05126-660b-4b2e-a63c-70177b23a3b4 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:33.349806 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b05126-660b-4b2e-a63c-70177b23a3b4 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:33.349806 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b05126-660b-4b2e-a63c-70177b23a3b4 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:33.351172 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 550/1096] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:53:33.356349 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdc794-ea38-4a84-885b-407e1128c0b5 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:33.356770 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdc794-ea38-4a84-885b-407e1128c0b5 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:33.356903 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdc794-ea38-4a84-885b-407e1128c0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:33.376641 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-61bdc794-ea38-4a84-885b-407e1128c0b5 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:53:33.377872 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-61bdc794-ea38-4a84-885b-407e1128c0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:53:33.385585 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 547/1097] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:53:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:53:33.743096 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b05126-660b-4b2e-a63c-70177b23a3b4 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:53:33.757869 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b05126-660b-4b2e-a63c-70177b23a3b4 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:53:33.762673 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3d2a0-efd8-4f17-9ef1-591c805c7daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:53:33.763254 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3d2a0-efd8-4f17-9ef1-591c805c7daa service nova] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:33.763550 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3d2a0-efd8-4f17-9ef1-591c805c7daa service nova] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:33.763817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3d2a0-efd8-4f17-9ef1-591c805c7daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:33.771931 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3d2a0-efd8-4f17-9ef1-591c805c7daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:53:33.773498 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3d2a0-efd8-4f17-9ef1-591c805c7daa service nova] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:53:33.782743 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 551/1098] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:53:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:53:36.166116 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7c2e1-760e-41bc-a339-fbce3410616a None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:36.166675 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7c2e1-760e-41bc-a339-fbce3410616a None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:36.166675 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7c2e1-760e-41bc-a339-fbce3410616a None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:36.167973 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 548/1099] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:53:36.173702 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1c10d-21fb-4120-b523-b0b1067b5ec5 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:36.174169 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1c10d-21fb-4120-b523-b0b1067b5ec5 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:36.174284 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1c10d-21fb-4120-b523-b0b1067b5ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:36.193098 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-7db1c10d-21fb-4120-b523-b0b1067b5ec5 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:53:36.194337 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-7db1c10d-21fb-4120-b523-b0b1067b5ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:53:36.202216 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 552/1100] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:53:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:53:36.555675 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7c2e1-760e-41bc-a339-fbce3410616a None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:53:36.566538 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7c2e1-760e-41bc-a339-fbce3410616a None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:53:36.570018 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881eba1-cd2f-4b7f-a60e-f169a0983343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:53:36.570598 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881eba1-cd2f-4b7f-a60e-f169a0983343 service neutron] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:36.570872 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881eba1-cd2f-4b7f-a60e-f169a0983343 service neutron] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:36.571143 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881eba1-cd2f-4b7f-a60e-f169a0983343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:36.580999 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881eba1-cd2f-4b7f-a60e-f169a0983343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:53:36.582455 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881eba1-cd2f-4b7f-a60e-f169a0983343 service neutron] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:53:36.591783 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 549/1101] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:53:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:53:38.829705 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24afb3-6cc4-4908-a970-6df907948447 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:38.830257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24afb3-6cc4-4908-a970-6df907948447 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:38.830257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24afb3-6cc4-4908-a970-6df907948447 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:38.831562 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 553/1102] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:53:38.836849 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78130c-877b-47a7-a67a-4247d17bcdd7 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:38.837294 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78130c-877b-47a7-a67a-4247d17bcdd7 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:38.837403 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78130c-877b-47a7-a67a-4247d17bcdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:38.856225 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-6e78130c-877b-47a7-a67a-4247d17bcdd7 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:53:38.857400 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-6e78130c-877b-47a7-a67a-4247d17bcdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:53:38.865943 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 550/1103] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:53:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:53:39.213610 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24afb3-6cc4-4908-a970-6df907948447 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:53:39.224966 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24afb3-6cc4-4908-a970-6df907948447 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:53:39.228467 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c97ef9-1ef6-449c-863e-45c84d3aad25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:53:39.229047 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c97ef9-1ef6-449c-863e-45c84d3aad25 service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:39.229326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c97ef9-1ef6-449c-863e-45c84d3aad25 service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:39.229596 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c97ef9-1ef6-449c-863e-45c84d3aad25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:39.238990 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c97ef9-1ef6-449c-863e-45c84d3aad25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:53:39.240410 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c97ef9-1ef6-449c-863e-45c84d3aad25 service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:53:39.249940 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 554/1104] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:53:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:53:41.532557 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faaa7c-8806-4ce1-874b-f88e668b8b58 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:41.533123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faaa7c-8806-4ce1-874b-f88e668b8b58 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:41.533123 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faaa7c-8806-4ce1-874b-f88e668b8b58 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:41.534520 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 551/1105] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:53:41.539535 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e588fdf-0446-4aaf-b5b9-0d4545c822aa None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:41.539912 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e588fdf-0446-4aaf-b5b9-0d4545c822aa None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:41.540073 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e588fdf-0446-4aaf-b5b9-0d4545c822aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:41.560330 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-9e588fdf-0446-4aaf-b5b9-0d4545c822aa None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:53:41.562186 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-9e588fdf-0446-4aaf-b5b9-0d4545c822aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:53:41.569985 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 555/1106] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:53:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:53:41.926649 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faaa7c-8806-4ce1-874b-f88e668b8b58 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:53:41.937484 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faaa7c-8806-4ce1-874b-f88e668b8b58 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:53:41.940977 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c9206-72dc-4fe2-8dc1-efaa825f8117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:53:41.941555 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c9206-72dc-4fe2-8dc1-efaa825f8117 service neutron] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:41.941866 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c9206-72dc-4fe2-8dc1-efaa825f8117 service neutron] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:41.942136 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c9206-72dc-4fe2-8dc1-efaa825f8117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:41.950818 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c9206-72dc-4fe2-8dc1-efaa825f8117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:53:41.953138 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c9206-72dc-4fe2-8dc1-efaa825f8117 service neutron] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:53:41.962732 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 552/1107] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:53:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:53:44.395514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc20d4-4d55-4ee4-91d8-e0855edf2c60 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:44.396100 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc20d4-4d55-4ee4-91d8-e0855edf2c60 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:44.396100 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc20d4-4d55-4ee4-91d8-e0855edf2c60 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:44.397399 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 556/1108] 10.222.0.30 () {54 vars in 927 bytes} [Wed Aug 17 14:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:53:44.402509 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4494d-686e-402a-8bbd-d0c27cf40550 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:44.402955 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4494d-686e-402a-8bbd-d0c27cf40550 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:44.403068 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4494d-686e-402a-8bbd-d0c27cf40550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:44.423636 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-e2f4494d-686e-402a-8bbd-d0c27cf40550 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:53:44.424834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-e2f4494d-686e-402a-8bbd-d0c27cf40550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:53:44.432719 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 553/1109] 10.222.0.30 () {58 vars in 1024 bytes} [Wed Aug 17 14:53:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:53:44.784055 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc20d4-4d55-4ee4-91d8-e0855edf2c60 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:53:44.794805 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc20d4-4d55-4ee4-91d8-e0855edf2c60 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:53:44.799063 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142defbd-7fe8-4a88-9d86-a16c4f8d8bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:53:44.799653 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142defbd-7fe8-4a88-9d86-a16c4f8d8bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:53:44.799934 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142defbd-7fe8-4a88-9d86-a16c4f8d8bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:53:44.800208 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142defbd-7fe8-4a88-9d86-a16c4f8d8bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:53:44.809002 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142defbd-7fe8-4a88-9d86-a16c4f8d8bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:53:44.810446 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142defbd-7fe8-4a88-9d86-a16c4f8d8bd0 service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:53:44.820371 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 557/1110] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:53:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:53:54.418082 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=33 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:53:54.816342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=33 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:55:09.020675 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921983b6-557b-4936-9dac-605b3c6a91bc None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:55:09.021291 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921983b6-557b-4936-9dac-605b3c6a91bc None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:55:09.021291 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921983b6-557b-4936-9dac-605b3c6a91bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:55:09.040010 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-921983b6-557b-4936-9dac-605b3c6a91bc None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:55:09.041188 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-921983b6-557b-4936-9dac-605b3c6a91bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:55:09.048907 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 554/1111] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 14:55:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:55:09.056818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b100d0-5744-4d86-8f6c-265c661fb8c8 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:55:09.057347 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b100d0-5744-4d86-8f6c-265c661fb8c8 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:55:09.057347 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b100d0-5744-4d86-8f6c-265c661fb8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:55:09.077282 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-a2b100d0-5744-4d86-8f6c-265c661fb8c8 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:55:09.078500 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-a2b100d0-5744-4d86-8f6c-265c661fb8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:55:09.086161 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 558/1112] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 14:55:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:55:09.090626 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921983b6-557b-4936-9dac-605b3c6a91bc None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:55:09.100039 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921983b6-557b-4936-9dac-605b3c6a91bc None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:55:09.104543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1989cc7-9567-4326-93cb-8a28ebc7056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:55:09.105532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1989cc7-9567-4326-93cb-8a28ebc7056c admin admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:55:09.105874 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1989cc7-9567-4326-93cb-8a28ebc7056c admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:55:09.106147 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1989cc7-9567-4326-93cb-8a28ebc7056c admin admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:55:09.106785 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1989cc7-9567-4326-93cb-8a28ebc7056c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:55:09.107080 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1989cc7-9567-4326-93cb-8a28ebc7056c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:55:09.108069 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: WARNING py.warnings [None req-e1989cc7-9567-4326-93cb-8a28ebc7056c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:55:09.108069 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: warnings.warn(msg) Aug 17 14:55:09.108069 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: Aug 17 14:55:09.108938 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1989cc7-9567-4326-93cb-8a28ebc7056c admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:55:09.120937 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 555/1113] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 17 14:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:55:09.129501 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b100d0-5744-4d86-8f6c-265c661fb8c8 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:55:09.139552 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b100d0-5744-4d86-8f6c-265c661fb8c8 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:55:09.144063 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6df5f-8e89-4011-aef8-0fc898e6c1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:55:09.144639 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6df5f-8e89-4011-aef8-0fc898e6c1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:55:09.144912 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6df5f-8e89-4011-aef8-0fc898e6c1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:55:09.145174 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6df5f-8e89-4011-aef8-0fc898e6c1e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:55:09.145806 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6df5f-8e89-4011-aef8-0fc898e6c1e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:55:09.147519 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: WARNING py.warnings [None req-59e6df5f-8e89-4011-aef8-0fc898e6c1e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:55:09.147519 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: warnings.warn(msg) Aug 17 14:55:09.147519 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: Aug 17 14:55:09.148693 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6df5f-8e89-4011-aef8-0fc898e6c1e5 admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:55:09.178447 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 559/1114] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 17 14:55:09 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:55:09.182524 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1989cc7-9567-4326-93cb-8a28ebc7056c admin admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:55:09.193201 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1989cc7-9567-4326-93cb-8a28ebc7056c admin admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:55:09.247950 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b081620-9a77-4680-b2ef-205af8488bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:55:09.248542 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b081620-9a77-4680-b2ef-205af8488bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:55:09.248822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b081620-9a77-4680-b2ef-205af8488bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:55:09.249091 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b081620-9a77-4680-b2ef-205af8488bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:55:09.249714 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b081620-9a77-4680-b2ef-205af8488bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:55:09.250744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: WARNING py.warnings [None req-8b081620-9a77-4680-b2ef-205af8488bf5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:55:09.250744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: warnings.warn(msg) Aug 17 14:55:09.250744 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: Aug 17 14:55:09.251925 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b081620-9a77-4680-b2ef-205af8488bf5 admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:55:09.272029 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 556/1115] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 17 14:55:09 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:55:09.276080 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6df5f-8e89-4011-aef8-0fc898e6c1e5 admin admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:55:09.287964 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6df5f-8e89-4011-aef8-0fc898e6c1e5 admin admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:55:09.294639 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6178930-3588-43ec-86f8-cc6b000271fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:55:09.295439 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6178930-3588-43ec-86f8-cc6b000271fe admin admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:55:09.295721 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6178930-3588-43ec-86f8-cc6b000271fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:55:09.295995 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6178930-3588-43ec-86f8-cc6b000271fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:55:09.296644 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6178930-3588-43ec-86f8-cc6b000271fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:55:09.297889 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: WARNING py.warnings [None req-b6178930-3588-43ec-86f8-cc6b000271fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:55:09.297889 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: warnings.warn(msg) Aug 17 14:55:09.297889 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: Aug 17 14:55:09.298948 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6178930-3588-43ec-86f8-cc6b000271fe admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:55:09.312200 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 560/1116] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 17 14:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:55:09.316287 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b081620-9a77-4680-b2ef-205af8488bf5 admin admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:55:09.326252 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b081620-9a77-4680-b2ef-205af8488bf5 admin admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:55:09.330702 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96f140-8034-4489-b885-797de3126b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:55:09.331279 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96f140-8034-4489-b885-797de3126b14 admin admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:55:09.331558 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96f140-8034-4489-b885-797de3126b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:55:09.331825 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96f140-8034-4489-b885-797de3126b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:55:09.332450 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96f140-8034-4489-b885-797de3126b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:55:09.333437 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: WARNING py.warnings [None req-9f96f140-8034-4489-b885-797de3126b14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:55:09.333437 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: warnings.warn(msg) Aug 17 14:55:09.333437 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: Aug 17 14:55:09.334345 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96f140-8034-4489-b885-797de3126b14 admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:55:09.347662 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 557/1117] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 17 14:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:55:09.351770 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6178930-3588-43ec-86f8-cc6b000271fe admin admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:55:09.362271 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6178930-3588-43ec-86f8-cc6b000271fe admin admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:55:09.366785 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091861a-7a45-41cf-a6a3-c6aa077ec144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:55:09.367674 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091861a-7a45-41cf-a6a3-c6aa077ec144 admin admin] REQUEST_METHOD: `PUT` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:55:09.367948 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091861a-7a45-41cf-a6a3-c6aa077ec144 admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:55:09.368245 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091861a-7a45-41cf-a6a3-c6aa077ec144 admin admin] PATH_INFO: `/v3/projects/e8765b7d258140ff91b17df68d8ea3c8/users/d53a4ca61ed746388f78173345237b71/roles/ab06ca80774d48a191fece38e3f335ad` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:55:09.383247 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091861a-7a45-41cf-a6a3-c6aa077ec144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8765b7d258140ff91b17df68d8ea3c8, user_id=d53a4ca61ed746388f78173345237b71, role_id=ab06ca80774d48a191fece38e3f335ad)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:55:09.384258 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: WARNING py.warnings [None req-1091861a-7a45-41cf-a6a3-c6aa077ec144 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:55:09.384258 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: warnings.warn(msg) Aug 17 14:55:09.384258 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: Aug 17 14:55:09.386942 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091861a-7a45-41cf-a6a3-c6aa077ec144 admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:55:09.399891 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 561/1118] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 17 14:55:09 2022] PUT /identity/v3/projects/e8765b7d258140ff91b17df68d8ea3c8/users/d53a4ca61ed746388f78173345237b71/roles/ab06ca80774d48a191fece38e3f335ad => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:55:09.412550 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d9e88-2d7a-4ed4-b1a0-ad2ea4f925bd None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:55:09.412864 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d9e88-2d7a-4ed4-b1a0-ad2ea4f925bd None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:55:09.413164 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d9e88-2d7a-4ed4-b1a0-ad2ea4f925bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:55:09.440635 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-a99d9e88-2d7a-4ed4-b1a0-ad2ea4f925bd None None] MFA Rules not processed for user `d53a4ca61ed746388f78173345237b71`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:55:09.441872 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-a99d9e88-2d7a-4ed4-b1a0-ad2ea4f925bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:55:09.503632 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 558/1119] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 14:55:09 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:55:09.519378 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673fa89-3140-4a46-b884-6f56c0dd29d1 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:55:09.519662 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673fa89-3140-4a46-b884-6f56c0dd29d1 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:55:09.519933 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673fa89-3140-4a46-b884-6f56c0dd29d1 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:55:09.521233 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 562/1120] 10.222.0.30 () {54 vars in 964 bytes} [Wed Aug 17 14:55:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:55:09.526208 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b124b-2b36-43f6-8697-71a5acd0d985 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:55:09.527197 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b124b-2b36-43f6-8697-71a5acd0d985 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:55:09.527510 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b124b-2b36-43f6-8697-71a5acd0d985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:55:09.546782 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-552b124b-2b36-43f6-8697-71a5acd0d985 None None] MFA Rules not processed for user `1dacf10fc91547788a9f8bbedfa0f553`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:55:09.548005 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-552b124b-2b36-43f6-8697-71a5acd0d985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:55:09.596253 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:55:09.604521 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 559/1121] 10.222.0.30 () {58 vars in 1061 bytes} [Wed Aug 17 14:55:09 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:55:09.612181 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673fa89-3140-4a46-b884-6f56c0dd29d1 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:55:09.623631 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673fa89-3140-4a46-b884-6f56c0dd29d1 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:55:09.627261 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f7f47-7d1a-4284-9b91-f266b48cc0c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacf10fc91547788a9f8bbedfa0f553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:55:09.627849 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f7f47-7d1a-4284-9b91-f266b48cc0c5 service cinder] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:55:09.628127 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f7f47-7d1a-4284-9b91-f266b48cc0c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:55:09.628400 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f7f47-7d1a-4284-9b91-f266b48cc0c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:55:09.637102 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f7f47-7d1a-4284-9b91-f266b48cc0c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:55:09.638547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f7f47-7d1a-4284-9b91-f266b48cc0c5 service cinder] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:55:09.647130 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 563/1122] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:55:09 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:55:09.685372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7ea87-fab2-433d-8e77-b75d5512ec0e None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:55:09.685652 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7ea87-fab2-433d-8e77-b75d5512ec0e None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:55:09.685977 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7ea87-fab2-433d-8e77-b75d5512ec0e None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:55:09.687229 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 560/1123] 10.222.0.30 () {52 vars in 830 bytes} [Wed Aug 17 14:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:55:09.690692 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f7f47-7d1a-4284-9b91-f266b48cc0c5 service cinder] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:55:09.752393 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f7f47-7d1a-4284-9b91-f266b48cc0c5 service cinder] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:55:09.756825 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403e74b-8dee-42a8-a158-92bfca9edb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:55:09.757433 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403e74b-8dee-42a8-a158-92bfca9edb06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:55:09.757710 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403e74b-8dee-42a8-a158-92bfca9edb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:55:09.758006 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403e74b-8dee-42a8-a158-92bfca9edb06 admin admin] PATH_INFO: `/v3/users/d53a4ca61ed746388f78173345237b71` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:55:09.759115 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403e74b-8dee-42a8-a158-92bfca9edb06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d53a4ca61ed746388f78173345237b71)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:55:09.760110 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: WARNING py.warnings [None req-1403e74b-8dee-42a8-a158-92bfca9edb06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:55:09.760110 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: warnings.warn(msg) Aug 17 14:55:09.760110 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: Aug 17 14:55:09.762291 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403e74b-8dee-42a8-a158-92bfca9edb06 admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:55:09.826615 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-1403e74b-8dee-42a8-a158-92bfca9edb06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd53a4ca61ed746388f78173345237b71'} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:55:09.827195 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-1403e74b-8dee-42a8-a158-92bfca9edb06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd53a4ca61ed746388f78173345237b71'} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:55:09.842299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-1403e74b-8dee-42a8-a158-92bfca9edb06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd53a4ca61ed746388f78173345237b71'} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:55:09.856395 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-1403e74b-8dee-42a8-a158-92bfca9edb06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd53a4ca61ed746388f78173345237b71'} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:55:09.879506 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-1403e74b-8dee-42a8-a158-92bfca9edb06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd53a4ca61ed746388f78173345237b71'} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:55:09.885469 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 564/1124] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 17 14:55:09 2022] DELETE /identity/v3/users/d53a4ca61ed746388f78173345237b71 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:55:09.890580 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ef67c-76b9-47b3-9b9c-20066bf4f5e6 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:55:09.890864 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ef67c-76b9-47b3-9b9c-20066bf4f5e6 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:55:09.891134 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ef67c-76b9-47b3-9b9c-20066bf4f5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:55:09.909336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-0c3ef67c-76b9-47b3-9b9c-20066bf4f5e6 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:55:09.910560 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-0c3ef67c-76b9-47b3-9b9c-20066bf4f5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:55:09.967341 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 561/1125] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 14:55:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:55:09.976816 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403e74b-8dee-42a8-a158-92bfca9edb06 admin admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:55:09.978284 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-1403e74b-8dee-42a8-a158-92bfca9edb06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:55:09.984590 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:55:10.037346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403e74b-8dee-42a8-a158-92bfca9edb06 admin admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:55:10.040965 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6acb1-bf8d-41f3-9bd7-8d98f75c1782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:55:10.041563 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6acb1-bf8d-41f3-9bd7-8d98f75c1782 service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:55:10.041873 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6acb1-bf8d-41f3-9bd7-8d98f75c1782 service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:55:10.042946 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6acb1-bf8d-41f3-9bd7-8d98f75c1782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:55:10.051780 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6acb1-bf8d-41f3-9bd7-8d98f75c1782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:55:10.053199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6acb1-bf8d-41f3-9bd7-8d98f75c1782 service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:55:10.063006 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 565/1126] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:55:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:55:10.416079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ef67c-76b9-47b3-9b9c-20066bf4f5e6 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:55:10.417702 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-0c3ef67c-76b9-47b3-9b9c-20066bf4f5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:55:10.430112 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ef67c-76b9-47b3-9b9c-20066bf4f5e6 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:55:10.437750 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe21712-f83a-4774-85ff-47bf753ce9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:55:10.438483 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe21712-f83a-4774-85ff-47bf753ce9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:55:10.438759 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe21712-f83a-4774-85ff-47bf753ce9af admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:55:10.439062 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe21712-f83a-4774-85ff-47bf753ce9af admin admin] PATH_INFO: `/v3/projects/e8765b7d258140ff91b17df68d8ea3c8` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:55:10.441030 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe21712-f83a-4774-85ff-47bf753ce9af admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8765b7d258140ff91b17df68d8ea3c8)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:55:10.442429 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: WARNING py.warnings [None req-ffe21712-f83a-4774-85ff-47bf753ce9af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:55:10.442429 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: warnings.warn(msg) Aug 17 14:55:10.442429 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: Aug 17 14:55:10.443607 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe21712-f83a-4774-85ff-47bf753ce9af admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:55:10.505680 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-ffe21712-f83a-4774-85ff-47bf753ce9af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8765b7d258140ff91b17df68d8ea3c8', 'request_id': 'req-ffe21712-f83a-4774-85ff-47bf753ce9af'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:55:10.516063 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-ffe21712-f83a-4774-85ff-47bf753ce9af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8765b7d258140ff91b17df68d8ea3c8', 'request_id': 'req-ffe21712-f83a-4774-85ff-47bf753ce9af'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:55:10.529586 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-ffe21712-f83a-4774-85ff-47bf753ce9af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8765b7d258140ff91b17df68d8ea3c8', 'request_id': 'req-ffe21712-f83a-4774-85ff-47bf753ce9af'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:55:10.540771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-ffe21712-f83a-4774-85ff-47bf753ce9af admin admin] The token cache is being invalidate because project e8765b7d258140ff91b17df68d8ea3c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:55:10.541058 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-ffe21712-f83a-4774-85ff-47bf753ce9af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:55:10.541795 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-ffe21712-f83a-4774-85ff-47bf753ce9af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:55:10.543570 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 562/1127] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 17 14:55:10 2022] DELETE /identity/v3/projects/e8765b7d258140ff91b17df68d8ea3c8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:55:20.059155 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=25 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:55:20.537880 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:56:34.450864 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154d1d8-a4ef-4c43-a99a-8d8ce5996b3a None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:34.451468 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154d1d8-a4ef-4c43-a99a-8d8ce5996b3a None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:34.451468 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154d1d8-a4ef-4c43-a99a-8d8ce5996b3a None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:34.452760 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 566/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:56:34.457583 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a7336-1010-4ee3-8f7f-aa097e33132b None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:34.458045 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a7336-1010-4ee3-8f7f-aa097e33132b None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:34.458184 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a7336-1010-4ee3-8f7f-aa097e33132b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:34.525114 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-0e7a7336-1010-4ee3-8f7f-aa097e33132b None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:56:34.526333 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-0e7a7336-1010-4ee3-8f7f-aa097e33132b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:56:34.623307 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 563/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:56:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:56:34.788811 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154d1d8-a4ef-4c43-a99a-8d8ce5996b3a None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:56:34.790542 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-9154d1d8-a4ef-4c43-a99a-8d8ce5996b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:56:34.880251 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154d1d8-a4ef-4c43-a99a-8d8ce5996b3a None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:56:34.885197 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24b80e-4c7d-4eaa-838a-41e179bd547e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:56:34.885826 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24b80e-4c7d-4eaa-838a-41e179bd547e service nova] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:34.886107 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24b80e-4c7d-4eaa-838a-41e179bd547e service nova] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:34.886375 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24b80e-4c7d-4eaa-838a-41e179bd547e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:34.894786 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24b80e-4c7d-4eaa-838a-41e179bd547e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:56:34.896351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24b80e-4c7d-4eaa-838a-41e179bd547e service nova] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:56:34.906092 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 567/1130] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:56:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:56:35.740929 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3408cb-eb99-4e25-bf99-300052372999 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:35.741779 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3408cb-eb99-4e25-bf99-300052372999 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:35.741779 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3408cb-eb99-4e25-bf99-300052372999 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:35.743109 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 564/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:56:35.748623 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165504fd-eda6-401c-9e39-d74aab9214de None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:35.749051 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165504fd-eda6-401c-9e39-d74aab9214de None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:35.749158 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165504fd-eda6-401c-9e39-d74aab9214de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:35.770235 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-165504fd-eda6-401c-9e39-d74aab9214de None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:56:35.772038 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-165504fd-eda6-401c-9e39-d74aab9214de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:56:35.780425 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 568/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:56:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:56:35.942788 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3408cb-eb99-4e25-bf99-300052372999 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:56:35.956450 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3408cb-eb99-4e25-bf99-300052372999 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:56:35.961252 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a192a9-b2a8-4140-8688-10ff8a395fbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:56:35.961878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a192a9-b2a8-4140-8688-10ff8a395fbc service nova] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:35.962158 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a192a9-b2a8-4140-8688-10ff8a395fbc service nova] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:35.962426 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a192a9-b2a8-4140-8688-10ff8a395fbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:35.971094 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a192a9-b2a8-4140-8688-10ff8a395fbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:56:35.972661 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a192a9-b2a8-4140-8688-10ff8a395fbc service nova] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:56:35.982693 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 565/1133] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:56:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:56:40.795070 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c41bba-424d-4f44-9afc-61c0f7e334c2 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:40.795629 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c41bba-424d-4f44-9afc-61c0f7e334c2 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:40.795629 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c41bba-424d-4f44-9afc-61c0f7e334c2 None None] PATH_INFO: `/v3` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:40.796857 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 569/1134] 10.222.0.50 () {54 vars in 925 bytes} [Wed Aug 17 14:56:40 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:56:40.802791 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52c8c2-7079-4c20-acd2-85e7cee06f2a None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:40.803162 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52c8c2-7079-4c20-acd2-85e7cee06f2a None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:40.803332 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52c8c2-7079-4c20-acd2-85e7cee06f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:40.834662 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-2c52c8c2-7079-4c20-acd2-85e7cee06f2a None None] MFA Rules not processed for user `ff30f486b0964765bef7665e2b2a9e35`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:56:40.835809 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-2c52c8c2-7079-4c20-acd2-85e7cee06f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:56:40.891409 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:56:40.901177 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 566/1135] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Aug 17 14:56:40 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:56:45.110846 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8015c-b279-4cf0-b4c7-06f2efb0efc0 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:45.111463 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8015c-b279-4cf0-b4c7-06f2efb0efc0 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:45.111463 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8015c-b279-4cf0-b4c7-06f2efb0efc0 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:45.112693 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 570/1136] 10.222.0.30 () {54 vars in 961 bytes} [Wed Aug 17 14:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:56:45.118029 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9591b-d358-4e1a-904d-27596f56f8c6 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:45.118445 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9591b-d358-4e1a-904d-27596f56f8c6 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:45.118566 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9591b-d358-4e1a-904d-27596f56f8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:45.138283 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-60d9591b-d358-4e1a-904d-27596f56f8c6 None None] MFA Rules not processed for user `ff30f486b0964765bef7665e2b2a9e35`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:56:45.139641 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-60d9591b-d358-4e1a-904d-27596f56f8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:56:45.148089 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 567/1137] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Aug 17 14:56:45 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:56:45.155199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8015c-b279-4cf0-b4c7-06f2efb0efc0 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:56:45.168334 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8015c-b279-4cf0-b4c7-06f2efb0efc0 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:56:45.173878 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acaa213-f3ad-42c3-adcc-7e83e6f5f9f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff30f486b0964765bef7665e2b2a9e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:56:45.174457 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaa213-f3ad-42c3-adcc-7e83e6f5f9f4 service placement] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:45.174736 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaa213-f3ad-42c3-adcc-7e83e6f5f9f4 service placement] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:45.175005 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaa213-f3ad-42c3-adcc-7e83e6f5f9f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:45.183378 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acaa213-f3ad-42c3-adcc-7e83e6f5f9f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:56:45.184931 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acaa213-f3ad-42c3-adcc-7e83e6f5f9f4 service placement] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:56:45.195409 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 571/1138] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:56:45 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:56:47.227061 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ca4c5-56f4-4b48-bd6a-b12457eae4f6 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:47.227536 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ca4c5-56f4-4b48-bd6a-b12457eae4f6 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:47.227639 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ca4c5-56f4-4b48-bd6a-b12457eae4f6 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:47.228921 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 568/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:56:47.233753 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d55932-61dc-451e-86b8-4174421f9339 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:47.234183 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d55932-61dc-451e-86b8-4174421f9339 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:47.234293 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d55932-61dc-451e-86b8-4174421f9339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:47.254270 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-a8d55932-61dc-451e-86b8-4174421f9339 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:56:47.255480 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-a8d55932-61dc-451e-86b8-4174421f9339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:56:47.263151 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 572/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:56:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:56:47.425389 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ca4c5-56f4-4b48-bd6a-b12457eae4f6 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:56:47.439644 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ca4c5-56f4-4b48-bd6a-b12457eae4f6 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:56:47.444430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e0d59-0ddd-43ce-aca1-e40ee2351b56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:56:47.445005 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e0d59-0ddd-43ce-aca1-e40ee2351b56 service nova] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:47.445277 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e0d59-0ddd-43ce-aca1-e40ee2351b56 service nova] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:47.445541 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e0d59-0ddd-43ce-aca1-e40ee2351b56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:47.453750 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e0d59-0ddd-43ce-aca1-e40ee2351b56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:56:47.455310 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e0d59-0ddd-43ce-aca1-e40ee2351b56 service nova] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:56:47.464909 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 569/1141] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:56:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:56:48.289353 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac2526-b4e3-4713-8441-8be421a79d47 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:48.289930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac2526-b4e3-4713-8441-8be421a79d47 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:48.289930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac2526-b4e3-4713-8441-8be421a79d47 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:48.291249 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 573/1142] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:56:48.295915 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f95103-9115-43d3-9f05-579074fde9ec None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:48.296332 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f95103-9115-43d3-9f05-579074fde9ec None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:48.296445 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f95103-9115-43d3-9f05-579074fde9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:48.315491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-28f95103-9115-43d3-9f05-579074fde9ec None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:56:48.316672 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-28f95103-9115-43d3-9f05-579074fde9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:56:48.324438 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 570/1143] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:56:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:56:48.479925 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac2526-b4e3-4713-8441-8be421a79d47 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:56:48.493700 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac2526-b4e3-4713-8441-8be421a79d47 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:56:48.499337 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7bd9b-53aa-4026-a26c-00a28884e2f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:56:48.499912 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7bd9b-53aa-4026-a26c-00a28884e2f9 service nova] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:48.500188 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7bd9b-53aa-4026-a26c-00a28884e2f9 service nova] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:48.500448 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7bd9b-53aa-4026-a26c-00a28884e2f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:48.508304 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7bd9b-53aa-4026-a26c-00a28884e2f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:56:48.509885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7bd9b-53aa-4026-a26c-00a28884e2f9 service nova] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:56:48.520023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 574/1144] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:56:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:56:52.488106 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a50ec-cbd4-468d-9e70-896c234d7c2a None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:52.488775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a50ec-cbd4-468d-9e70-896c234d7c2a None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:52.488775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a50ec-cbd4-468d-9e70-896c234d7c2a None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:52.490010 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 571/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:56:52.495284 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c410cb5-cdc5-4fd2-9338-28c9e41523ad None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:52.495704 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c410cb5-cdc5-4fd2-9338-28c9e41523ad None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:52.495826 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c410cb5-cdc5-4fd2-9338-28c9e41523ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:52.515586 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-6c410cb5-cdc5-4fd2-9338-28c9e41523ad None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:56:52.516771 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-6c410cb5-cdc5-4fd2-9338-28c9e41523ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:56:52.524462 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 575/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:56:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:56:52.869743 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a50ec-cbd4-468d-9e70-896c234d7c2a None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:56:52.871448 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-2e3a50ec-cbd4-468d-9e70-896c234d7c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:56:52.930271 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a50ec-cbd4-468d-9e70-896c234d7c2a None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:56:52.933763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d556967-9367-442a-8671-a183bc72c596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:56:52.934363 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d556967-9367-442a-8671-a183bc72c596 service neutron] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:52.934641 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d556967-9367-442a-8671-a183bc72c596 service neutron] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:52.934912 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d556967-9367-442a-8671-a183bc72c596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:52.944597 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d556967-9367-442a-8671-a183bc72c596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:56:52.946045 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d556967-9367-442a-8671-a183bc72c596 service neutron] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:56:52.955820 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 572/1147] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:56:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:56:55.151593 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483f05a-faf1-42bd-a927-cb06a7b14946 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:55.152208 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483f05a-faf1-42bd-a927-cb06a7b14946 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:55.152208 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483f05a-faf1-42bd-a927-cb06a7b14946 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:55.153441 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 576/1148] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:56:55.159422 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8231fb-0d84-43f7-91b3-0679fe49b547 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:55.159875 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8231fb-0d84-43f7-91b3-0679fe49b547 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:55.159978 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8231fb-0d84-43f7-91b3-0679fe49b547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:55.179714 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-7e8231fb-0d84-43f7-91b3-0679fe49b547 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:56:55.180940 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-7e8231fb-0d84-43f7-91b3-0679fe49b547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:56:55.188816 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 573/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:56:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:56:55.537715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483f05a-faf1-42bd-a927-cb06a7b14946 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:56:55.549187 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483f05a-faf1-42bd-a927-cb06a7b14946 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:56:55.552709 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7613a5b-93e6-44bf-9291-be95c9f55c99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:56:55.553305 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7613a5b-93e6-44bf-9291-be95c9f55c99 service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:55.553582 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7613a5b-93e6-44bf-9291-be95c9f55c99 service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:55.553887 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7613a5b-93e6-44bf-9291-be95c9f55c99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:55.563767 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7613a5b-93e6-44bf-9291-be95c9f55c99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:56:55.565184 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7613a5b-93e6-44bf-9291-be95c9f55c99 service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:56:55.574581 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 577/1150] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:56:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:56:59.555904 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710d7f6-43a6-4b9d-b439-5fc1608391c9 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:59.556491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710d7f6-43a6-4b9d-b439-5fc1608391c9 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:59.556491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710d7f6-43a6-4b9d-b439-5fc1608391c9 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:59.557800 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 574/1151] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:56:59.563274 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1b141-1ba4-40d8-b683-19e8d3f22b28 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:56:59.563708 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1b141-1ba4-40d8-b683-19e8d3f22b28 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:56:59.563804 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1b141-1ba4-40d8-b683-19e8d3f22b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:56:59.583265 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-fdd1b141-1ba4-40d8-b683-19e8d3f22b28 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:56:59.584441 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-fdd1b141-1ba4-40d8-b683-19e8d3f22b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:56:59.592933 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 578/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:56:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:57:00.164285 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710d7f6-43a6-4b9d-b439-5fc1608391c9 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:57:00.166058 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-8710d7f6-43a6-4b9d-b439-5fc1608391c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:57:00.224957 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710d7f6-43a6-4b9d-b439-5fc1608391c9 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:57:00.228468 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957043c-a222-4eb3-9909-f824b35ff939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacf10fc91547788a9f8bbedfa0f553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:57:00.229059 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957043c-a222-4eb3-9909-f824b35ff939 service cinder] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:57:00.229333 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957043c-a222-4eb3-9909-f824b35ff939 service cinder] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:57:00.229600 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957043c-a222-4eb3-9909-f824b35ff939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:57:00.238924 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957043c-a222-4eb3-9909-f824b35ff939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:57:00.240315 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957043c-a222-4eb3-9909-f824b35ff939 service cinder] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:57:00.250202 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 575/1153] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:57:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:57:02.442334 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d55b3a-d5ec-40ac-9978-4a84fc5ab1c5 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:57:02.442928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d55b3a-d5ec-40ac-9978-4a84fc5ab1c5 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:57:02.442928 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d55b3a-d5ec-40ac-9978-4a84fc5ab1c5 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:57:02.444173 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 579/1154] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:57:02.449173 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705e45a-eec0-4a92-adad-6fa2fc572049 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:57:02.449564 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705e45a-eec0-4a92-adad-6fa2fc572049 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:57:02.449710 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705e45a-eec0-4a92-adad-6fa2fc572049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:57:02.470217 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-9705e45a-eec0-4a92-adad-6fa2fc572049 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:57:02.471477 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-9705e45a-eec0-4a92-adad-6fa2fc572049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:57:02.479520 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 576/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:57:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:57:03.054955 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d55b3a-d5ec-40ac-9978-4a84fc5ab1c5 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:57:03.056621 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-01d55b3a-d5ec-40ac-9978-4a84fc5ab1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:57:03.064203 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=70 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:57:03.070579 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d55b3a-d5ec-40ac-9978-4a84fc5ab1c5 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:57:03.074089 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964fce1-e209-40b3-b2de-70b9e1194a9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacf10fc91547788a9f8bbedfa0f553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:57:03.074669 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964fce1-e209-40b3-b2de-70b9e1194a9a service cinder] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:57:03.074949 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964fce1-e209-40b3-b2de-70b9e1194a9a service cinder] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:57:03.075216 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964fce1-e209-40b3-b2de-70b9e1194a9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:57:03.084583 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964fce1-e209-40b3-b2de-70b9e1194a9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:57:03.086014 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964fce1-e209-40b3-b2de-70b9e1194a9a service cinder] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:57:03.096186 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 580/1156] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:57:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:57:12.464474 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=70 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:57:13.091743 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=5 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:58:17.957503 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1be50-82f3-4476-9ad6-45f352c58380 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:17.958473 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2647ffe-068f-4789-9325-6a37c1edbb9d None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:17.958897 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1be50-82f3-4476-9ad6-45f352c58380 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:17.958996 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2647ffe-068f-4789-9325-6a37c1edbb9d None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:17.959080 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1be50-82f3-4476-9ad6-45f352c58380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:17.959170 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2647ffe-068f-4789-9325-6a37c1edbb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:17.978115 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-a2647ffe-068f-4789-9325-6a37c1edbb9d None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:58:17.978351 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-59f1be50-82f3-4476-9ad6-45f352c58380 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:58:17.988344 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-a2647ffe-068f-4789-9325-6a37c1edbb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:17.988495 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-59f1be50-82f3-4476-9ad6-45f352c58380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:17.996634 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 577/1157] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 14:58:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:58:17.997156 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 581/1158] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 14:58:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:58:18.004685 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e1236-1479-4057-9de8-9ee4773b4ef7 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:18.004963 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e1236-1479-4057-9de8-9ee4773b4ef7 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:18.005084 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decba0d5-af09-409e-a2a2-ca6c6da53252 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:18.005233 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e1236-1479-4057-9de8-9ee4773b4ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:18.005342 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decba0d5-af09-409e-a2a2-ca6c6da53252 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:18.005517 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decba0d5-af09-409e-a2a2-ca6c6da53252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:18.024767 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-cc4e1236-1479-4057-9de8-9ee4773b4ef7 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:58:18.025089 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-decba0d5-af09-409e-a2a2-ca6c6da53252 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:58:18.026145 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-cc4e1236-1479-4057-9de8-9ee4773b4ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:18.026446 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-decba0d5-af09-409e-a2a2-ca6c6da53252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:18.033952 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 578/1159] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 14:58:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:58:18.037583 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 582/1160] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 14:58:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:58:18.038539 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e1236-1479-4057-9de8-9ee4773b4ef7 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:18.038666 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decba0d5-af09-409e-a2a2-ca6c6da53252 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:18.048265 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decba0d5-af09-409e-a2a2-ca6c6da53252 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:18.048430 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e1236-1479-4057-9de8-9ee4773b4ef7 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:18.052818 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792d7be-6d99-4d45-9251-01c398dc5f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:18.052981 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566718c2-5bf3-470e-a808-18d7eeedf537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:18.053400 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792d7be-6d99-4d45-9251-01c398dc5f5d admin admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:18.053516 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566718c2-5bf3-470e-a808-18d7eeedf537 admin admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:18.053677 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792d7be-6d99-4d45-9251-01c398dc5f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:18.053833 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566718c2-5bf3-470e-a808-18d7eeedf537 admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:18.053987 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792d7be-6d99-4d45-9251-01c398dc5f5d admin admin] PATH_INFO: `/v3/domains` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:18.054106 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566718c2-5bf3-470e-a808-18d7eeedf537 admin admin] PATH_INFO: `/v3/domains` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:18.054627 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792d7be-6d99-4d45-9251-01c398dc5f5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:58:18.054733 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566718c2-5bf3-470e-a808-18d7eeedf537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:58:18.054927 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792d7be-6d99-4d45-9251-01c398dc5f5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:18.055030 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566718c2-5bf3-470e-a808-18d7eeedf537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:18.055934 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: WARNING py.warnings [None req-f792d7be-6d99-4d45-9251-01c398dc5f5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:58:18.055934 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: warnings.warn(msg) Aug 17 14:58:18.055934 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: Aug 17 14:58:18.056627 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566718c2-5bf3-470e-a808-18d7eeedf537 admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:18.057574 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792d7be-6d99-4d45-9251-01c398dc5f5d admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:18.069267 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 579/1161] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 17 14:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:58:18.069926 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 583/1162] 10.222.0.30 () {58 vars in 1153 bytes} [Wed Aug 17 14:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:58:18.077345 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566718c2-5bf3-470e-a808-18d7eeedf537 admin admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:18.077537 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792d7be-6d99-4d45-9251-01c398dc5f5d admin admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:18.087213 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792d7be-6d99-4d45-9251-01c398dc5f5d admin admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:18.087373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566718c2-5bf3-470e-a808-18d7eeedf537 admin admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:18.091873 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa42ff-1b38-4f6e-a743-63be7a4c3327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:18.092018 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a16c5-9d89-49ae-8ddb-93fb49834a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:18.092446 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa42ff-1b38-4f6e-a743-63be7a4c3327 admin admin] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:18.092558 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a16c5-9d89-49ae-8ddb-93fb49834a2e admin admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:18.092717 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa42ff-1b38-4f6e-a743-63be7a4c3327 admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:18.092814 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a16c5-9d89-49ae-8ddb-93fb49834a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:18.092982 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa42ff-1b38-4f6e-a743-63be7a4c3327 admin admin] PATH_INFO: `/v3/projects` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:18.093082 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a16c5-9d89-49ae-8ddb-93fb49834a2e admin admin] PATH_INFO: `/v3/projects` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:18.093593 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa42ff-1b38-4f6e-a743-63be7a4c3327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:18.093700 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a16c5-9d89-49ae-8ddb-93fb49834a2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:18.094779 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: WARNING py.warnings [None req-439a16c5-9d89-49ae-8ddb-93fb49834a2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:58:18.094779 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: warnings.warn(msg) Aug 17 14:58:18.094779 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: Aug 17 14:58:18.095863 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa42ff-1b38-4f6e-a743-63be7a4c3327 admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:18.096012 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a16c5-9d89-49ae-8ddb-93fb49834a2e admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:18.138053 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 580/1163] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 17 14:58:18 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:58:18.138266 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 584/1164] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 17 14:58:18 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:58:18.139036 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a16c5-9d89-49ae-8ddb-93fb49834a2e admin admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:18.140741 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa42ff-1b38-4f6e-a743-63be7a4c3327 admin admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:18.202701 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a16c5-9d89-49ae-8ddb-93fb49834a2e admin admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:18.202949 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa42ff-1b38-4f6e-a743-63be7a4c3327 admin admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:18.207410 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a97a04-9159-44ac-bb40-0958c9a5577a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:18.207733 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1d9fe-2bf1-4a81-85d8-93c97700cd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:18.208041 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97a04-9159-44ac-bb40-0958c9a5577a admin admin] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:18.208273 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1d9fe-2bf1-4a81-85d8-93c97700cd36 admin admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:18.208382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97a04-9159-44ac-bb40-0958c9a5577a admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:18.208548 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1d9fe-2bf1-4a81-85d8-93c97700cd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:18.208672 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97a04-9159-44ac-bb40-0958c9a5577a admin admin] PATH_INFO: `/v3/users` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:18.208818 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1d9fe-2bf1-4a81-85d8-93c97700cd36 admin admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:18.209194 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a97a04-9159-44ac-bb40-0958c9a5577a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:18.209452 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1d9fe-2bf1-4a81-85d8-93c97700cd36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:18.210237 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: WARNING py.warnings [None req-c3a97a04-9159-44ac-bb40-0958c9a5577a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:58:18.210237 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: warnings.warn(msg) Aug 17 14:58:18.210237 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: Aug 17 14:58:18.211375 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1d9fe-2bf1-4a81-85d8-93c97700cd36 admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:18.211479 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a97a04-9159-44ac-bb40-0958c9a5577a admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:18.233706 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 585/1165] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 17 14:58:18 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:58:18.238158 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 581/1166] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 17 14:58:18 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:58:18.238302 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a97a04-9159-44ac-bb40-0958c9a5577a admin admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:18.239424 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1d9fe-2bf1-4a81-85d8-93c97700cd36 admin admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:18.250227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a97a04-9159-44ac-bb40-0958c9a5577a admin admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:18.252384 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1d9fe-2bf1-4a81-85d8-93c97700cd36 admin admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:18.256622 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2c7d0-c630-431b-a7f9-c42787c06bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:18.256923 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e4495-1067-40ba-b601-ea4ed10c972d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:18.257215 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2c7d0-c630-431b-a7f9-c42787c06bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:18.257493 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2c7d0-c630-431b-a7f9-c42787c06bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:18.257588 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e4495-1067-40ba-b601-ea4ed10c972d admin admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:18.257794 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2c7d0-c630-431b-a7f9-c42787c06bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:18.257913 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e4495-1067-40ba-b601-ea4ed10c972d admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:18.258088 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e4495-1067-40ba-b601-ea4ed10c972d admin admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:18.258436 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2c7d0-c630-431b-a7f9-c42787c06bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:18.258718 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e4495-1067-40ba-b601-ea4ed10c972d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:18.260865 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2c7d0-c630-431b-a7f9-c42787c06bd7 admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:18.261316 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e4495-1067-40ba-b601-ea4ed10c972d admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:18.271210 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 582/1167] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 17 14:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:58:18.274062 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 586/1168] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 17 14:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:58:18.275098 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e4495-1067-40ba-b601-ea4ed10c972d admin admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:18.275231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2c7d0-c630-431b-a7f9-c42787c06bd7 admin admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:18.285575 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2c7d0-c630-431b-a7f9-c42787c06bd7 admin admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:18.285763 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e4495-1067-40ba-b601-ea4ed10c972d admin admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:18.290069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309190e-b688-4788-aaee-7ccc6e319ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:18.290286 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d4d6b-8807-4ec9-a643-c29fa15b2e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:18.290640 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309190e-b688-4788-aaee-7ccc6e319ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:18.290837 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d4d6b-8807-4ec9-a643-c29fa15b2e6b admin admin] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:18.290949 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309190e-b688-4788-aaee-7ccc6e319ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:18.291124 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d4d6b-8807-4ec9-a643-c29fa15b2e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:18.291296 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309190e-b688-4788-aaee-7ccc6e319ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:18.291447 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d4d6b-8807-4ec9-a643-c29fa15b2e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:18.292083 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d4d6b-8807-4ec9-a643-c29fa15b2e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:18.292183 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309190e-b688-4788-aaee-7ccc6e319ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:18.293649 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d4d6b-8807-4ec9-a643-c29fa15b2e6b admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:18.293773 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309190e-b688-4788-aaee-7ccc6e319ce3 admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:18.303976 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 587/1169] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 17 14:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:58:18.304881 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 583/1170] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 17 14:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:58:18.308048 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309190e-b688-4788-aaee-7ccc6e319ce3 admin admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:18.310932 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d4d6b-8807-4ec9-a643-c29fa15b2e6b admin admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:18.318040 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309190e-b688-4788-aaee-7ccc6e319ce3 admin admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:18.320532 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d4d6b-8807-4ec9-a643-c29fa15b2e6b admin admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:18.323200 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2c810-bc58-49d1-84bd-ca6d76dcdc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:18.323835 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2c810-bc58-49d1-84bd-ca6d76dcdc4b admin admin] REQUEST_METHOD: `PUT` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:18.324113 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2c810-bc58-49d1-84bd-ca6d76dcdc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:18.324382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2c810-bc58-49d1-84bd-ca6d76dcdc4b admin admin] PATH_INFO: `/v3/projects/827b951e26dc475dbfb538fd09911172/users/dab39fe6f0b44d70a83ff3cc9f8fccb6/roles/ab06ca80774d48a191fece38e3f335ad` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:18.326014 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0ddeb-e879-430d-aca8-d11a5a906146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:18.326648 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0ddeb-e879-430d-aca8-d11a5a906146 admin admin] REQUEST_METHOD: `PUT` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:18.326962 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0ddeb-e879-430d-aca8-d11a5a906146 admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:18.327255 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0ddeb-e879-430d-aca8-d11a5a906146 admin admin] PATH_INFO: `/v3/projects/340a130604ef4dc68580a032db80174f/users/a185b1c40a6b404697dca78b8b3cacae/roles/ab06ca80774d48a191fece38e3f335ad` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:18.340798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2c810-bc58-49d1-84bd-ca6d76dcdc4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=827b951e26dc475dbfb538fd09911172, user_id=dab39fe6f0b44d70a83ff3cc9f8fccb6, role_id=ab06ca80774d48a191fece38e3f335ad)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:18.342251 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0ddeb-e879-430d-aca8-d11a5a906146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=340a130604ef4dc68580a032db80174f, user_id=a185b1c40a6b404697dca78b8b3cacae, role_id=ab06ca80774d48a191fece38e3f335ad)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:18.343271 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: WARNING py.warnings [None req-4af0ddeb-e879-430d-aca8-d11a5a906146 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:58:18.343271 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: warnings.warn(msg) Aug 17 14:58:18.343271 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: Aug 17 14:58:18.343577 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2c810-bc58-49d1-84bd-ca6d76dcdc4b admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:18.345168 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0ddeb-e879-430d-aca8-d11a5a906146 admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:18.357551 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 588/1171] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 17 14:58:18 2022] PUT /identity/v3/projects/827b951e26dc475dbfb538fd09911172/users/dab39fe6f0b44d70a83ff3cc9f8fccb6/roles/ab06ca80774d48a191fece38e3f335ad => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:58:18.358176 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 584/1172] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 17 14:58:18 2022] PUT /identity/v3/projects/340a130604ef4dc68580a032db80174f/users/a185b1c40a6b404697dca78b8b3cacae/roles/ab06ca80774d48a191fece38e3f335ad => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:58:18.362636 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1492873-4a38-4b1d-b82b-749178a62c9f None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:18.363004 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1492873-4a38-4b1d-b82b-749178a62c9f None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:18.363348 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1492873-4a38-4b1d-b82b-749178a62c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:18.365590 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304dab9-cccd-4f7e-b081-c216794a8861 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:18.366294 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304dab9-cccd-4f7e-b081-c216794a8861 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:18.366578 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304dab9-cccd-4f7e-b081-c216794a8861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:18.383374 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-b1492873-4a38-4b1d-b82b-749178a62c9f None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:58:18.384578 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-b1492873-4a38-4b1d-b82b-749178a62c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:18.385931 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-f304dab9-cccd-4f7e-b081-c216794a8861 None None] MFA Rules not processed for user `4b2dd9ba613b47b8b4618c0c2e6e4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:58:18.387103 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-f304dab9-cccd-4f7e-b081-c216794a8861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:18.428247 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:58:18.430327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:58:18.448962 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 585/1173] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 14:58:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:58:18.451558 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 589/1174] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 14:58:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:58:18.458890 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304dab9-cccd-4f7e-b081-c216794a8861 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:18.461989 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1492873-4a38-4b1d-b82b-749178a62c9f None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:18.463996 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-b1492873-4a38-4b1d-b82b-749178a62c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:18.515261 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304dab9-cccd-4f7e-b081-c216794a8861 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:18.518918 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fde63-b342-4523-871f-9701c4bfb32a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:18.519512 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fde63-b342-4523-871f-9701c4bfb32a service neutron] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:18.519789 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fde63-b342-4523-871f-9701c4bfb32a service neutron] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:18.520058 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fde63-b342-4523-871f-9701c4bfb32a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:18.529918 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fde63-b342-4523-871f-9701c4bfb32a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:18.531336 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fde63-b342-4523-871f-9701c4bfb32a service neutron] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:18.534198 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1492873-4a38-4b1d-b82b-749178a62c9f None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:18.537898 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecab0b-edaa-49ac-a3b3-ce3ac73ff4b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:18.538499 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecab0b-edaa-49ac-a3b3-ce3ac73ff4b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:18.538829 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecab0b-edaa-49ac-a3b3-ce3ac73ff4b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:18.539050 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecab0b-edaa-49ac-a3b3-ce3ac73ff4b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:18.540689 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 586/1175] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:58:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:58:18.549444 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecab0b-edaa-49ac-a3b3-ce3ac73ff4b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:18.550996 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecab0b-edaa-49ac-a3b3-ce3ac73ff4b2 service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:18.562538 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 590/1176] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:58:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:58:23.954939 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c93449-1451-433f-8ec1-548a01791442 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:23.955436 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c93449-1451-433f-8ec1-548a01791442 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:23.955629 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c93449-1451-433f-8ec1-548a01791442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:24.013764 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-73c93449-1451-433f-8ec1-548a01791442 None None] MFA Rules not processed for user `a185b1c40a6b404697dca78b8b3cacae`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:58:24.016105 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-73c93449-1451-433f-8ec1-548a01791442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:24.114737 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 587/1177] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 14:58:23 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:58:24.120849 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecab0b-edaa-49ac-a3b3-ce3ac73ff4b2 service neutron] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:24.131692 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecab0b-edaa-49ac-a3b3-ce3ac73ff4b2 service neutron] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:24.138024 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fbfbc-17d7-4419-8933-715d0f75424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:24.138884 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fbfbc-17d7-4419-8933-715d0f75424a admin admin] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:24.139264 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fbfbc-17d7-4419-8933-715d0f75424a admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:24.139745 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fbfbc-17d7-4419-8933-715d0f75424a admin admin] PATH_INFO: `/v3/projects` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:24.140488 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fbfbc-17d7-4419-8933-715d0f75424a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:24.143322 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fbfbc-17d7-4419-8933-715d0f75424a admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:24.199606 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 591/1178] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 17 14:58:24 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:58:24.200902 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c93449-1451-433f-8ec1-548a01791442 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:24.212553 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c93449-1451-433f-8ec1-548a01791442 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:24.315802 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580f906-acbe-4a03-b591-3ee8176b50d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:24.316509 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580f906-acbe-4a03-b591-3ee8176b50d3 admin admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:24.316826 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580f906-acbe-4a03-b591-3ee8176b50d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:24.317100 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580f906-acbe-4a03-b591-3ee8176b50d3 admin admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:24.318044 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580f906-acbe-4a03-b591-3ee8176b50d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:24.320515 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580f906-acbe-4a03-b591-3ee8176b50d3 admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:24.351414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 588/1179] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 17 14:58:24 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:58:24.352689 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fbfbc-17d7-4419-8933-715d0f75424a admin admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:24.372412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fbfbc-17d7-4419-8933-715d0f75424a admin admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:24.379640 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9ab30-d343-45d5-ba69-97394defe739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:24.380415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9ab30-d343-45d5-ba69-97394defe739 admin admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:24.380953 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9ab30-d343-45d5-ba69-97394defe739 admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:24.381334 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9ab30-d343-45d5-ba69-97394defe739 admin admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:24.382439 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9ab30-d343-45d5-ba69-97394defe739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:24.384228 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9ab30-d343-45d5-ba69-97394defe739 admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:24.404405 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 592/1180] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 17 14:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:58:24.408991 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580f906-acbe-4a03-b591-3ee8176b50d3 admin admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:24.427775 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580f906-acbe-4a03-b591-3ee8176b50d3 admin admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:24.436173 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb105b-afce-40b6-82d2-5504e9e78ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:24.437445 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb105b-afce-40b6-82d2-5504e9e78ef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:24.437445 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb105b-afce-40b6-82d2-5504e9e78ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:24.437445 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb105b-afce-40b6-82d2-5504e9e78ef9 admin admin] PATH_INFO: `/v3/projects/fb59738745c84ebd826f8ddf38e8090b/users/23da6bfb3673411486cff26bfaf94cb3/roles/a307f157f2a445c7af8bd4fd41aa1c4b` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:24.441771 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:58:24.458823 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb105b-afce-40b6-82d2-5504e9e78ef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb59738745c84ebd826f8ddf38e8090b, user_id=23da6bfb3673411486cff26bfaf94cb3, role_id=a307f157f2a445c7af8bd4fd41aa1c4b)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:24.461568 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb105b-afce-40b6-82d2-5504e9e78ef9 admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:24.481781 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 589/1181] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 17 14:58:24 2022] PUT /identity/v3/projects/fb59738745c84ebd826f8ddf38e8090b/users/23da6bfb3673411486cff26bfaf94cb3/roles/a307f157f2a445c7af8bd4fd41aa1c4b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:58:24.485653 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9ab30-d343-45d5-ba69-97394defe739 admin admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:24.500242 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9ab30-d343-45d5-ba69-97394defe739 admin admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:24.536812 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f6805-9eca-41c3-be09-69fc8a0f578f None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:24.537095 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f6805-9eca-41c3-be09-69fc8a0f578f None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:24.537379 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f6805-9eca-41c3-be09-69fc8a0f578f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:24.570883 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-749f6805-9eca-41c3-be09-69fc8a0f578f None None] MFA Rules not processed for user `dab39fe6f0b44d70a83ff3cc9f8fccb6`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:58:24.572975 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-749f6805-9eca-41c3-be09-69fc8a0f578f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:24.595071 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7068283-d13c-4a5a-959b-ff9cf2cf8eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:24.595722 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7068283-d13c-4a5a-959b-ff9cf2cf8eca admin admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:24.595979 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7068283-d13c-4a5a-959b-ff9cf2cf8eca admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:24.596261 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7068283-d13c-4a5a-959b-ff9cf2cf8eca admin admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:24.597263 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7068283-d13c-4a5a-959b-ff9cf2cf8eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:24.599467 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7068283-d13c-4a5a-959b-ff9cf2cf8eca admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:24.616299 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 593/1182] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 17 14:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:58:24.617265 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7068283-d13c-4a5a-959b-ff9cf2cf8eca admin admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:24.627816 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7068283-d13c-4a5a-959b-ff9cf2cf8eca admin admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:24.632720 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c68fea-b22b-448c-b23a-f9c6fcd5a986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:24.633373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c68fea-b22b-448c-b23a-f9c6fcd5a986 admin admin] REQUEST_METHOD: `PUT` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:24.633763 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c68fea-b22b-448c-b23a-f9c6fcd5a986 admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:24.634052 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c68fea-b22b-448c-b23a-f9c6fcd5a986 admin admin] PATH_INFO: `/v3/projects/fb59738745c84ebd826f8ddf38e8090b/users/23da6bfb3673411486cff26bfaf94cb3/roles/a307f157f2a445c7af8bd4fd41aa1c4b` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:24.638513 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c68fea-b22b-448c-b23a-f9c6fcd5a986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb59738745c84ebd826f8ddf38e8090b, user_id=23da6bfb3673411486cff26bfaf94cb3, role_id=a307f157f2a445c7af8bd4fd41aa1c4b)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:24.646228 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c68fea-b22b-448c-b23a-f9c6fcd5a986 admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:24.660270 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 594/1183] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 17 14:58:24 2022] PUT /identity/v3/projects/fb59738745c84ebd826f8ddf38e8090b/users/23da6bfb3673411486cff26bfaf94cb3/roles/a307f157f2a445c7af8bd4fd41aa1c4b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:58:24.671779 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 590/1184] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 14:58:24 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:58:24.676043 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c68fea-b22b-448c-b23a-f9c6fcd5a986 admin admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:24.725547 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:58:24.769382 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c68fea-b22b-448c-b23a-f9c6fcd5a986 admin admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:24.776237 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782af2cc-86bf-410d-b098-ca03cc65458f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:24.777046 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782af2cc-86bf-410d-b098-ca03cc65458f admin admin] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:24.777436 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782af2cc-86bf-410d-b098-ca03cc65458f admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:24.784500 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782af2cc-86bf-410d-b098-ca03cc65458f admin admin] PATH_INFO: `/v3/projects` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:24.785253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782af2cc-86bf-410d-b098-ca03cc65458f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:24.787426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782af2cc-86bf-410d-b098-ca03cc65458f admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:24.826186 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 595/1185] 10.222.0.30 () {60 vars in 1153 bytes} [Wed Aug 17 14:58:24 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:58:24.830543 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f6805-9eca-41c3-be09-69fc8a0f578f None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:24.850228 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f6805-9eca-41c3-be09-69fc8a0f578f None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:24.954846 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8200e-d452-464b-83f5-70ef4c788efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:24.955952 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8200e-d452-464b-83f5-70ef4c788efc admin admin] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:24.956995 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8200e-d452-464b-83f5-70ef4c788efc admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:24.957673 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8200e-d452-464b-83f5-70ef4c788efc admin admin] PATH_INFO: `/v3/users` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:24.958422 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8200e-d452-464b-83f5-70ef4c788efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:24.961807 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8200e-d452-464b-83f5-70ef4c788efc admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:24.987478 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 591/1186] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Aug 17 14:58:24 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:58:24.992594 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782af2cc-86bf-410d-b098-ca03cc65458f admin admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:25.009383 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782af2cc-86bf-410d-b098-ca03cc65458f admin admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:25.015797 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ba189-e823-4c80-a7c1-ffd72eb5a3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:25.016406 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ba189-e823-4c80-a7c1-ffd72eb5a3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:25.016682 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ba189-e823-4c80-a7c1-ffd72eb5a3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:25.016949 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ba189-e823-4c80-a7c1-ffd72eb5a3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:25.017591 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ba189-e823-4c80-a7c1-ffd72eb5a3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:25.019600 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ba189-e823-4c80-a7c1-ffd72eb5a3d8 admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:25.049171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8200e-d452-464b-83f5-70ef4c788efc admin admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:25.049334 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 596/1187] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 17 14:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:58:25.070311 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8200e-d452-464b-83f5-70ef4c788efc admin admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:25.077330 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd3e2e-da29-4bf8-be63-2706cf3721d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:25.078246 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd3e2e-da29-4bf8-be63-2706cf3721d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:25.078697 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd3e2e-da29-4bf8-be63-2706cf3721d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:25.078987 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd3e2e-da29-4bf8-be63-2706cf3721d4 admin admin] PATH_INFO: `/v3/projects/1d2d5559908245a1a8a3ea4f399c3440/users/1d71f9680a8247799e4a6cdb7f81389a/roles/a307f157f2a445c7af8bd4fd41aa1c4b` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:25.099372 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd3e2e-da29-4bf8-be63-2706cf3721d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d2d5559908245a1a8a3ea4f399c3440, user_id=1d71f9680a8247799e4a6cdb7f81389a, role_id=a307f157f2a445c7af8bd4fd41aa1c4b)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:25.102182 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd3e2e-da29-4bf8-be63-2706cf3721d4 admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:25.118166 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 592/1188] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 17 14:58:25 2022] PUT /identity/v3/projects/1d2d5559908245a1a8a3ea4f399c3440/users/1d71f9680a8247799e4a6cdb7f81389a/roles/a307f157f2a445c7af8bd4fd41aa1c4b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:58:25.126276 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ba189-e823-4c80-a7c1-ffd72eb5a3d8 admin admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:25.140765 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ba189-e823-4c80-a7c1-ffd72eb5a3d8 admin admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:25.223425 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc368724-b087-455a-93c4-090886d49c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:25.224211 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc368724-b087-455a-93c4-090886d49c8a admin admin] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:25.224645 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc368724-b087-455a-93c4-090886d49c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:25.224924 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc368724-b087-455a-93c4-090886d49c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:25.225586 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc368724-b087-455a-93c4-090886d49c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:25.227230 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc368724-b087-455a-93c4-090886d49c8a admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:25.246462 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 597/1189] 10.222.0.30 () {58 vars in 1122 bytes} [Wed Aug 17 14:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:58:25.250433 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd3e2e-da29-4bf8-be63-2706cf3721d4 admin admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:25.262755 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd3e2e-da29-4bf8-be63-2706cf3721d4 admin admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:25.268665 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385df4a-6de1-4e55-9282-25be1207b03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:25.269622 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385df4a-6de1-4e55-9282-25be1207b03d admin admin] REQUEST_METHOD: `PUT` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:25.270173 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385df4a-6de1-4e55-9282-25be1207b03d admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:25.270709 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385df4a-6de1-4e55-9282-25be1207b03d admin admin] PATH_INFO: `/v3/projects/1d2d5559908245a1a8a3ea4f399c3440/users/1d71f9680a8247799e4a6cdb7f81389a/roles/a307f157f2a445c7af8bd4fd41aa1c4b` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:25.274163 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385df4a-6de1-4e55-9282-25be1207b03d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d2d5559908245a1a8a3ea4f399c3440, user_id=1d71f9680a8247799e4a6cdb7f81389a, role_id=a307f157f2a445c7af8bd4fd41aa1c4b)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:25.277490 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385df4a-6de1-4e55-9282-25be1207b03d admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:25.293856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 593/1190] 10.222.0.30 () {60 vars in 1483 bytes} [Wed Aug 17 14:58:25 2022] PUT /identity/v3/projects/1d2d5559908245a1a8a3ea4f399c3440/users/1d71f9680a8247799e4a6cdb7f81389a/roles/a307f157f2a445c7af8bd4fd41aa1c4b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:58:30.807898 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adbfcc-2636-4900-b0cd-086874d90e93 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:30.808470 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adbfcc-2636-4900-b0cd-086874d90e93 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:30.808470 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adbfcc-2636-4900-b0cd-086874d90e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:30.861197 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-61adbfcc-2636-4900-b0cd-086874d90e93 None None] MFA Rules not processed for user `23da6bfb3673411486cff26bfaf94cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:58:30.862464 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-61adbfcc-2636-4900-b0cd-086874d90e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:31.007290 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 598/1191] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 14:58:30 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:58:31.024608 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385df4a-6de1-4e55-9282-25be1207b03d admin admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:31.028009 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-5385df4a-6de1-4e55-9282-25be1207b03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:31.079520 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:58:31.206886 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385df4a-6de1-4e55-9282-25be1207b03d admin admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:31.212571 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415e186-38b8-4545-be84-1001061c342b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272278199c5149a1ad326f22ef11f4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:31.213938 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415e186-38b8-4545-be84-1001061c342b service glance] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:31.214319 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415e186-38b8-4545-be84-1001061c342b service glance] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:31.214658 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415e186-38b8-4545-be84-1001061c342b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:31.336988 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415e186-38b8-4545-be84-1001061c342b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:31.340403 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415e186-38b8-4545-be84-1001061c342b service glance] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:31.360843 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 594/1192] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:58:31 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:58:31.444381 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393ce7d-aa46-454c-9849-6de6cc670ded None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:31.444676 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393ce7d-aa46-454c-9849-6de6cc670ded None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:31.445131 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393ce7d-aa46-454c-9849-6de6cc670ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:31.498611 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-7393ce7d-aa46-454c-9849-6de6cc670ded None None] MFA Rules not processed for user `1d71f9680a8247799e4a6cdb7f81389a`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:58:31.499962 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-7393ce7d-aa46-454c-9849-6de6cc670ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:31.515091 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:58:31.605159 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 599/1193] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 14:58:31 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:58:31.613282 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415e186-38b8-4545-be84-1001061c342b service glance] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:31.615059 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-1415e186-38b8-4545-be84-1001061c342b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:31.631958 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415e186-38b8-4545-be84-1001061c342b service glance] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:31.637400 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6d48e-0ef4-487a-b7c2-2af2cfddf58c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272278199c5149a1ad326f22ef11f4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:31.638134 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6d48e-0ef4-487a-b7c2-2af2cfddf58c service glance] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:31.638487 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6d48e-0ef4-487a-b7c2-2af2cfddf58c service glance] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:31.638829 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6d48e-0ef4-487a-b7c2-2af2cfddf58c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:31.724955 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6d48e-0ef4-487a-b7c2-2af2cfddf58c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:31.726708 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6d48e-0ef4-487a-b7c2-2af2cfddf58c service glance] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:31.739768 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 595/1194] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:58:31 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:58:40.299238 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52960d84-587f-4464-8bfa-e0926bd0aecf None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:40.299892 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52960d84-587f-4464-8bfa-e0926bd0aecf None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:40.299892 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52960d84-587f-4464-8bfa-e0926bd0aecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:40.324742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-52960d84-587f-4464-8bfa-e0926bd0aecf None None] MFA Rules not processed for user `dab39fe6f0b44d70a83ff3cc9f8fccb6`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:58:40.326164 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-52960d84-587f-4464-8bfa-e0926bd0aecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:40.333507 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 600/1195] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 14:58:40 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:58:40.674448 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f2264-9f0d-4b0a-82b2-dac65ac64add None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:40.675014 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f2264-9f0d-4b0a-82b2-dac65ac64add None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:40.675014 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f2264-9f0d-4b0a-82b2-dac65ac64add None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:40.676422 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 596/1196] 10.222.0.30 () {54 vars in 962 bytes} [Wed Aug 17 14:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:58:40.682979 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd5b3b-7cd7-450b-9a41-4967caf2f460 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:40.684489 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd5b3b-7cd7-450b-9a41-4967caf2f460 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:40.684831 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd5b3b-7cd7-450b-9a41-4967caf2f460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:40.718015 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-41cd5b3b-7cd7-450b-9a41-4967caf2f460 None None] MFA Rules not processed for user `8aca6a001d3b479bab684772768d49f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:58:40.719263 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-41cd5b3b-7cd7-450b-9a41-4967caf2f460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:40.813605 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 601/1197] 10.222.0.30 () {58 vars in 1059 bytes} [Wed Aug 17 14:58:40 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:58:40.819119 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73b7ab-aa78-4339-b87f-81c4436cf28a None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:40.819468 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73b7ab-aa78-4339-b87f-81c4436cf28a None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:40.820079 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73b7ab-aa78-4339-b87f-81c4436cf28a None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:40.822487 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 597/1198] 10.222.0.30 () {54 vars in 912 bytes} [Wed Aug 17 14:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:58:40.826901 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4af90-8314-4b56-b263-77f21fef1519 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:40.827411 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4af90-8314-4b56-b263-77f21fef1519 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:40.827847 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4af90-8314-4b56-b263-77f21fef1519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:40.851104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-1fd4af90-8314-4b56-b263-77f21fef1519 None None] MFA Rules not processed for user `8aca6a001d3b479bab684772768d49f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:58:40.852415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-1fd4af90-8314-4b56-b263-77f21fef1519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:40.862545 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 602/1199] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Aug 17 14:58:40 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:58:40.879798 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73b7ab-aa78-4339-b87f-81c4436cf28a None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:40.895133 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73b7ab-aa78-4339-b87f-81c4436cf28a None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:40.902047 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb5ee0-98ed-43dc-81ff-48e97800c5f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272278199c5149a1ad326f22ef11f4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:40.903690 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb5ee0-98ed-43dc-81ff-48e97800c5f2 service glance] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:40.904103 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb5ee0-98ed-43dc-81ff-48e97800c5f2 service glance] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:40.904439 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb5ee0-98ed-43dc-81ff-48e97800c5f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:40.917235 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb5ee0-98ed-43dc-81ff-48e97800c5f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:40.919944 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb5ee0-98ed-43dc-81ff-48e97800c5f2 service glance] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:40.940230 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 598/1200] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:58:40 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:58:41.465285 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f078876-3b06-4b0c-a76a-a1ed817c0b18 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:41.466392 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f078876-3b06-4b0c-a76a-a1ed817c0b18 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:41.466893 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f078876-3b06-4b0c-a76a-a1ed817c0b18 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:41.468579 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 603/1201] 10.222.0.30 () {54 vars in 912 bytes} [Wed Aug 17 14:58:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:58:41.474549 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8a51c-5c37-47cb-b908-9c7e23c1ef41 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:41.474914 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8a51c-5c37-47cb-b908-9c7e23c1ef41 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:41.475251 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8a51c-5c37-47cb-b908-9c7e23c1ef41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:41.496367 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-04a8a51c-5c37-47cb-b908-9c7e23c1ef41 None None] MFA Rules not processed for user `1e4147647f54499ba24b50fbecc5d38f`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:58:41.497665 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-04a8a51c-5c37-47cb-b908-9c7e23c1ef41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:41.553013 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 599/1202] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Aug 17 14:58:41 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:58:41.564951 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f078876-3b06-4b0c-a76a-a1ed817c0b18 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:41.576506 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f078876-3b06-4b0c-a76a-a1ed817c0b18 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:41.580104 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba424f3-1b48-48c0-aaba-e20d1569deaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:41.580684 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba424f3-1b48-48c0-aaba-e20d1569deaf service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:41.580956 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba424f3-1b48-48c0-aaba-e20d1569deaf service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:41.581345 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba424f3-1b48-48c0-aaba-e20d1569deaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:41.588719 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba424f3-1b48-48c0-aaba-e20d1569deaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:41.590260 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba424f3-1b48-48c0-aaba-e20d1569deaf service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:41.598516 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 604/1203] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:58:41 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:58:42.109856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e74b29-12c0-45cb-843d-6eaf47c294eb None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:42.110359 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e74b29-12c0-45cb-843d-6eaf47c294eb None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:42.110461 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e74b29-12c0-45cb-843d-6eaf47c294eb None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:42.111922 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 600/1204] 10.222.0.30 () {54 vars in 962 bytes} [Wed Aug 17 14:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:58:42.120159 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64fe23-7c5e-44a6-bac9-fa8e28c818c0 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:42.120453 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64fe23-7c5e-44a6-bac9-fa8e28c818c0 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:42.120781 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64fe23-7c5e-44a6-bac9-fa8e28c818c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:42.121545 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581d496-fa97-4522-9fa0-3a9a554aa20f None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:42.121884 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581d496-fa97-4522-9fa0-3a9a554aa20f None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:42.122326 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581d496-fa97-4522-9fa0-3a9a554aa20f None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:42.123916 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 601/1205] 10.222.0.30 () {54 vars in 961 bytes} [Wed Aug 17 14:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:58:42.128893 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2a7d3-72cf-4370-9cf2-e2974a8d293e None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:42.129180 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2a7d3-72cf-4370-9cf2-e2974a8d293e None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:42.129454 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2a7d3-72cf-4370-9cf2-e2974a8d293e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:42.139753 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=100 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:58:42.143389 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-1c64fe23-7c5e-44a6-bac9-fa8e28c818c0 None None] MFA Rules not processed for user `8aca6a001d3b479bab684772768d49f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:58:42.144837 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-1c64fe23-7c5e-44a6-bac9-fa8e28c818c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:42.153204 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-dbe2a7d3-72cf-4370-9cf2-e2974a8d293e None None] MFA Rules not processed for user `ff30f486b0964765bef7665e2b2a9e35`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:58:42.154640 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-dbe2a7d3-72cf-4370-9cf2-e2974a8d293e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:42.158138 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 605/1206] 10.222.0.30 () {58 vars in 1059 bytes} [Wed Aug 17 14:58:42 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:58:42.161990 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f935a0-7faf-4e12-ad9e-9650b4261f7b None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:42.162914 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f935a0-7faf-4e12-ad9e-9650b4261f7b None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:42.163357 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f935a0-7faf-4e12-ad9e-9650b4261f7b None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:42.166720 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 606/1207] 10.222.0.30 () {54 vars in 912 bytes} [Wed Aug 17 14:58:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:58:42.172842 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807531ae-48b7-4ec6-8eae-2e0fc7a39ca8 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:42.173205 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807531ae-48b7-4ec6-8eae-2e0fc7a39ca8 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:42.173544 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807531ae-48b7-4ec6-8eae-2e0fc7a39ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:42.198406 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-807531ae-48b7-4ec6-8eae-2e0fc7a39ca8 None None] MFA Rules not processed for user `8aca6a001d3b479bab684772768d49f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:58:42.199783 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-807531ae-48b7-4ec6-8eae-2e0fc7a39ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:42.219439 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 607/1208] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Aug 17 14:58:42 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:58:42.233168 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807531ae-48b7-4ec6-8eae-2e0fc7a39ca8 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:42.245453 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807531ae-48b7-4ec6-8eae-2e0fc7a39ca8 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:42.249487 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b2454-a8a9-400b-b5d9-66a09d06b8aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:42.250147 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b2454-a8a9-400b-b5d9-66a09d06b8aa service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:42.250431 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b2454-a8a9-400b-b5d9-66a09d06b8aa service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:42.250692 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b2454-a8a9-400b-b5d9-66a09d06b8aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:42.252675 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 602/1209] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Aug 17 14:58:42 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:58:42.253973 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2a7d3-72cf-4370-9cf2-e2974a8d293e None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:42.263156 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b2454-a8a9-400b-b5d9-66a09d06b8aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:42.264845 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b2454-a8a9-400b-b5d9-66a09d06b8aa service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:42.271533 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2a7d3-72cf-4370-9cf2-e2974a8d293e None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:42.277426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 608/1210] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:58:42 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:58:42.279644 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6889c5-6860-403f-b016-e860eccc1872 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff30f486b0964765bef7665e2b2a9e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:42.280281 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6889c5-6860-403f-b016-e860eccc1872 service placement] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:42.280562 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6889c5-6860-403f-b016-e860eccc1872 service placement] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:42.280830 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6889c5-6860-403f-b016-e860eccc1872 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:42.282645 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-0b6889c5-6860-403f-b016-e860eccc1872 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:42.295856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6889c5-6860-403f-b016-e860eccc1872 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:42.297581 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6889c5-6860-403f-b016-e860eccc1872 service placement] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:42.311913 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 603/1211] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:58:42 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:58:52.271387 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=81 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:58:52.306404 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=33 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:58:53.715112 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2381fa-912e-4592-a9d8-841bb2d46c71 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:53.715687 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2381fa-912e-4592-a9d8-841bb2d46c71 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:53.715800 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2381fa-912e-4592-a9d8-841bb2d46c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:53.735522 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-6e2381fa-912e-4592-a9d8-841bb2d46c71 None None] MFA Rules not processed for user `1e4147647f54499ba24b50fbecc5d38f`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:58:53.736798 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-6e2381fa-912e-4592-a9d8-841bb2d46c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:53.744093 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 609/1212] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Aug 17 14:58:53 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:58:53.756680 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6889c5-6860-403f-b016-e860eccc1872 service placement] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:53.766573 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6889c5-6860-403f-b016-e860eccc1872 service placement] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:53.770542 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698c8be-7326-4d2d-aad0-1adc19fbfb6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:53.771131 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698c8be-7326-4d2d-aad0-1adc19fbfb6e service neutron] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:53.771414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698c8be-7326-4d2d-aad0-1adc19fbfb6e service neutron] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:53.771689 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698c8be-7326-4d2d-aad0-1adc19fbfb6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:53.779832 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698c8be-7326-4d2d-aad0-1adc19fbfb6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:53.781244 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698c8be-7326-4d2d-aad0-1adc19fbfb6e service neutron] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:53.790604 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 604/1213] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:58:53 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:58:54.549552 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fdb8b-dda6-41ff-ab13-cb746f7bfca8 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:54.552864 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fdb8b-dda6-41ff-ab13-cb746f7bfca8 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:54.553354 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fdb8b-dda6-41ff-ab13-cb746f7bfca8 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:54.555699 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 610/1214] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 17 14:58:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:58:54.591404 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae006628-c8bb-47c4-b8d0-7f025a2f3c73 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:54.591933 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae006628-c8bb-47c4-b8d0-7f025a2f3c73 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:54.592379 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae006628-c8bb-47c4-b8d0-7f025a2f3c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:54.614161 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-ae006628-c8bb-47c4-b8d0-7f025a2f3c73 None None] MFA Rules not processed for user `8aca6a001d3b479bab684772768d49f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:58:54.615953 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-ae006628-c8bb-47c4-b8d0-7f025a2f3c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:58:54.625090 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 605/1215] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 17 14:58:54 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:58:54.655261 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fdb8b-dda6-41ff-ab13-cb746f7bfca8 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:58:54.679542 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fdb8b-dda6-41ff-ab13-cb746f7bfca8 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:58:54.696334 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515840b-27c2-474f-8d4d-378392802004 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:58:54.697109 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515840b-27c2-474f-8d4d-378392802004 service nova] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:58:54.697384 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515840b-27c2-474f-8d4d-378392802004 service nova] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:58:54.697659 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515840b-27c2-474f-8d4d-378392802004 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:58:54.707679 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515840b-27c2-474f-8d4d-378392802004 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:58:54.709262 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515840b-27c2-474f-8d4d-378392802004 service nova] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:58:54.721036 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 611/1216] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:58:54 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:59:01.059282 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984fe8b-4bb6-4b0e-8b24-cb2b451c8897 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:59:01.060353 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984fe8b-4bb6-4b0e-8b24-cb2b451c8897 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:59:01.060796 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984fe8b-4bb6-4b0e-8b24-cb2b451c8897 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:59:01.062246 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 606/1217] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 17 14:59:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:59:01.074843 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed4255-63e5-4b2e-b7f1-3f7a61e3f5e6 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:59:01.075482 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed4255-63e5-4b2e-b7f1-3f7a61e3f5e6 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:59:01.075482 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed4255-63e5-4b2e-b7f1-3f7a61e3f5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:59:01.097069 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-45ed4255-63e5-4b2e-b7f1-3f7a61e3f5e6 None None] MFA Rules not processed for user `8aca6a001d3b479bab684772768d49f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:59:01.098814 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-45ed4255-63e5-4b2e-b7f1-3f7a61e3f5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:59:01.109257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 612/1218] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 17 14:59:01 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:59:01.124836 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984fe8b-4bb6-4b0e-8b24-cb2b451c8897 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:59:01.140655 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984fe8b-4bb6-4b0e-8b24-cb2b451c8897 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:59:01.146503 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628e461-5ced-496d-849f-f34566ad20ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:59:01.147094 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628e461-5ced-496d-849f-f34566ad20ce service nova] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:59:01.147373 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628e461-5ced-496d-849f-f34566ad20ce service nova] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:59:01.147642 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628e461-5ced-496d-849f-f34566ad20ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:59:01.156551 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628e461-5ced-496d-849f-f34566ad20ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:59:01.158209 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628e461-5ced-496d-849f-f34566ad20ce service nova] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:59:01.167995 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 607/1219] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:59:01 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:59:11.092000 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=12 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:59:11.163796 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=15 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:59:13.969011 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed4255-63e5-4b2e-b7f1-3f7a61e3f5e6 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:59:13.979057 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed4255-63e5-4b2e-b7f1-3f7a61e3f5e6 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:59:13.983942 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2e38a-41e3-49e9-b0db-af27396f4f98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:59:13.984541 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2e38a-41e3-49e9-b0db-af27396f4f98 service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:59:13.984816 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2e38a-41e3-49e9-b0db-af27396f4f98 service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:59:13.985085 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2e38a-41e3-49e9-b0db-af27396f4f98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:59:13.995716 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2e38a-41e3-49e9-b0db-af27396f4f98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:59:13.997143 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2e38a-41e3-49e9-b0db-af27396f4f98 service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:59:14.006909 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 613/1220] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:59:13 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:59:16.059708 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869e310-224d-41ef-bb07-aa3ba3e50a33 None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:59:16.060302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869e310-224d-41ef-bb07-aa3ba3e50a33 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:59:16.060302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869e310-224d-41ef-bb07-aa3ba3e50a33 None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:59:16.062044 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 608/1221] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 17 14:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:59:16.071389 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6001016-7d5a-4a26-ba15-80a4a8b5c5e9 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:59:16.072623 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6001016-7d5a-4a26-ba15-80a4a8b5c5e9 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:59:16.073169 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6001016-7d5a-4a26-ba15-80a4a8b5c5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:59:16.127698 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-f6001016-7d5a-4a26-ba15-80a4a8b5c5e9 None None] MFA Rules not processed for user `8aca6a001d3b479bab684772768d49f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:59:16.129627 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-f6001016-7d5a-4a26-ba15-80a4a8b5c5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:59:16.141495 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 614/1222] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 17 14:59:16 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:59:16.159749 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869e310-224d-41ef-bb07-aa3ba3e50a33 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:59:16.181834 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869e310-224d-41ef-bb07-aa3ba3e50a33 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:59:16.187589 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc18f9c-d6cd-460c-afb3-c624e972ab7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:59:16.188481 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc18f9c-d6cd-460c-afb3-c624e972ab7a service nova] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:59:16.188917 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc18f9c-d6cd-460c-afb3-c624e972ab7a service nova] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:59:16.189371 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc18f9c-d6cd-460c-afb3-c624e972ab7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:59:16.202254 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc18f9c-d6cd-460c-afb3-c624e972ab7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:59:16.204645 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc18f9c-d6cd-460c-afb3-c624e972ab7a service nova] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:59:16.230320 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 609/1223] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:59:16 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:59:26.113914 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=9 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:59:26.224792 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=6 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:59:29.327271 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb714f-2133-4415-a792-5412283e4057 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:59:29.327835 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb714f-2133-4415-a792-5412283e4057 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:59:29.327835 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb714f-2133-4415-a792-5412283e4057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:59:29.346619 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-15eb714f-2133-4415-a792-5412283e4057 None None] MFA Rules not processed for user `a185b1c40a6b404697dca78b8b3cacae`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:59:29.347755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-15eb714f-2133-4415-a792-5412283e4057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:59:29.355253 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 615/1224] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 14:59:29 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:59:29.707554 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37447978-f8cf-4348-a41e-eff12545723d None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:59:29.708035 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37447978-f8cf-4348-a41e-eff12545723d None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:59:29.708142 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37447978-f8cf-4348-a41e-eff12545723d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:59:29.727293 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-37447978-f8cf-4348-a41e-eff12545723d None None] MFA Rules not processed for user `1e4147647f54499ba24b50fbecc5d38f`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:59:29.729202 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-37447978-f8cf-4348-a41e-eff12545723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:59:29.735508 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 610/1225] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Aug 17 14:59:29 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:59:29.746817 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb714f-2133-4415-a792-5412283e4057 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:59:29.756071 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb714f-2133-4415-a792-5412283e4057 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:59:29.759646 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b349bf8-908e-48d0-b353-c5c5133ef7c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:59:29.760231 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b349bf8-908e-48d0-b353-c5c5133ef7c7 service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:59:29.760505 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b349bf8-908e-48d0-b353-c5c5133ef7c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:59:29.760774 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b349bf8-908e-48d0-b353-c5c5133ef7c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:59:29.767665 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b349bf8-908e-48d0-b353-c5c5133ef7c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:59:29.769066 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b349bf8-908e-48d0-b353-c5c5133ef7c7 service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:59:29.777300 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 616/1226] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 14:59:29 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:59:39.722628 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=3 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:59:39.773426 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=9 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:59:53.428977 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3119d-ad4a-4a0b-a21a-428456fc280d None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:59:53.429486 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3119d-ad4a-4a0b-a21a-428456fc280d None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:59:53.429486 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3119d-ad4a-4a0b-a21a-428456fc280d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:59:53.447923 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-d1f3119d-ad4a-4a0b-a21a-428456fc280d None None] MFA Rules not processed for user `a185b1c40a6b404697dca78b8b3cacae`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:59:53.449040 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-d1f3119d-ad4a-4a0b-a21a-428456fc280d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:59:53.457025 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 611/1227] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 14:59:53 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 15:00:03.442881 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=3 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:00:08.034416 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2238df-f0e3-469c-b61e-09e3709b7711 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:00:08.035199 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2238df-f0e3-469c-b61e-09e3709b7711 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:00:08.035343 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2238df-f0e3-469c-b61e-09e3709b7711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:00:08.054591 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-7d2238df-f0e3-469c-b61e-09e3709b7711 None None] MFA Rules not processed for user `a185b1c40a6b404697dca78b8b3cacae`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 15:00:08.055780 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-7d2238df-f0e3-469c-b61e-09e3709b7711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 15:00:08.062589 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 617/1228] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 15:00:08 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 15:00:18.049932 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=3 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:01:05.734250 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e21381-5d98-4f84-af8d-baaf3a3f990f None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:01:05.734723 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e21381-5d98-4f84-af8d-baaf3a3f990f None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:01:05.734824 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e21381-5d98-4f84-af8d-baaf3a3f990f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:01:05.754692 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-59e21381-5d98-4f84-af8d-baaf3a3f990f None None] MFA Rules not processed for user `a185b1c40a6b404697dca78b8b3cacae`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 15:01:05.755878 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-59e21381-5d98-4f84-af8d-baaf3a3f990f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 15:01:05.763686 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 612/1229] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 15:01:05 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 15:01:15.748747 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=3 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:01:18.737572 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2238df-f0e3-469c-b61e-09e3709b7711 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:01:18.757227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2238df-f0e3-469c-b61e-09e3709b7711 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:01:18.761124 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726d325-c06e-400e-a9b1-e40ce8795292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:01:18.761715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726d325-c06e-400e-a9b1-e40ce8795292 service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:01:18.762025 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726d325-c06e-400e-a9b1-e40ce8795292 service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:01:18.762302 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726d325-c06e-400e-a9b1-e40ce8795292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:01:18.771303 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726d325-c06e-400e-a9b1-e40ce8795292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:01:18.772745 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726d325-c06e-400e-a9b1-e40ce8795292 service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:01:18.782056 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 618/1230] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 15:01:18 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 15:01:28.778000 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=10 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:02:45.016320 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e21381-5d98-4f84-af8d-baaf3a3f990f None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:02:45.038126 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e21381-5d98-4f84-af8d-baaf3a3f990f None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:02:45.043181 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aedc74-1227-4225-8bea-aa032419a8d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff30f486b0964765bef7665e2b2a9e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:02:45.043778 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aedc74-1227-4225-8bea-aa032419a8d7 service placement] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:02:45.044060 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aedc74-1227-4225-8bea-aa032419a8d7 service placement] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:02:45.044333 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aedc74-1227-4225-8bea-aa032419a8d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:02:45.053094 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aedc74-1227-4225-8bea-aa032419a8d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:02:45.054727 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aedc74-1227-4225-8bea-aa032419a8d7 service placement] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:02:45.064306 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 613/1231] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 15:02:45 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 15:02:55.060304 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=10 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:03:29.408667 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d55d10-892a-42cc-bfb5-bb5123835aea None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:03:29.409168 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d55d10-892a-42cc-bfb5-bb5123835aea None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:03:29.409257 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d55d10-892a-42cc-bfb5-bb5123835aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:03:29.429428 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-66d55d10-892a-42cc-bfb5-bb5123835aea None None] MFA Rules not processed for user `a185b1c40a6b404697dca78b8b3cacae`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 15:03:29.430664 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-66d55d10-892a-42cc-bfb5-bb5123835aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 15:03:29.438201 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 619/1232] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 15:03:29 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 15:03:31.315085 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aedc74-1227-4225-8bea-aa032419a8d7 service placement] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:03:31.326170 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aedc74-1227-4225-8bea-aa032419a8d7 service placement] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:03:31.331406 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33dbd82-01d5-46c7-b157-09f1fc9c53c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:03:31.332095 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dbd82-01d5-46c7-b157-09f1fc9c53c7 service neutron] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:03:31.332437 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dbd82-01d5-46c7-b157-09f1fc9c53c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:03:31.332772 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dbd82-01d5-46c7-b157-09f1fc9c53c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:03:31.342739 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33dbd82-01d5-46c7-b157-09f1fc9c53c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:03:31.344198 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33dbd82-01d5-46c7-b157-09f1fc9c53c7 service neutron] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:03:31.354879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 614/1233] 10.222.0.30 () {60 vars in 1396 bytes} [Wed Aug 17 15:03:31 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 2814 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 15:03:39.424349 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=3 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:03:40.817485 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d55d10-892a-42cc-bfb5-bb5123835aea None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:03:40.827803 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d55d10-892a-42cc-bfb5-bb5123835aea None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:03:40.831361 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4dacb4-8680-4332-818e-a0f647f8178b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:03:40.831954 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dacb4-8680-4332-818e-a0f647f8178b service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:03:40.832232 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dacb4-8680-4332-818e-a0f647f8178b service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:03:40.832503 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dacb4-8680-4332-818e-a0f647f8178b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:03:40.841968 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4dacb4-8680-4332-818e-a0f647f8178b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:03:40.843386 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4dacb4-8680-4332-818e-a0f647f8178b service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:03:40.862466 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 620/1234] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 15:03:40 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 15:03:41.349877 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=6 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:03:50.522394 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33dbd82-01d5-46c7-b157-09f1fc9c53c7 service neutron] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:03:50.535444 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33dbd82-01d5-46c7-b157-09f1fc9c53c7 service neutron] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:03:50.541558 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fc4fc-1619-4436-af84-46a747d364f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:03:50.542217 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fc4fc-1619-4436-af84-46a747d364f5 service nova] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:03:50.542491 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fc4fc-1619-4436-af84-46a747d364f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:03:50.542755 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fc4fc-1619-4436-af84-46a747d364f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:03:50.552360 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fc4fc-1619-4436-af84-46a747d364f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:03:50.554289 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fc4fc-1619-4436-af84-46a747d364f5 service nova] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:03:50.566454 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 615/1235] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 15:03:50 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 15:03:50.619152 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4dacb4-8680-4332-818e-a0f647f8178b service neutron] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:03:50.628036 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4dacb4-8680-4332-818e-a0f647f8178b service neutron] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:03:50.631658 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22566733-d502-4ea6-9b90-cbbc4b372735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:03:50.632274 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22566733-d502-4ea6-9b90-cbbc4b372735 service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:03:50.632578 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22566733-d502-4ea6-9b90-cbbc4b372735 service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:03:50.632846 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22566733-d502-4ea6-9b90-cbbc4b372735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:03:50.643304 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22566733-d502-4ea6-9b90-cbbc4b372735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:03:50.644827 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22566733-d502-4ea6-9b90-cbbc4b372735 service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:03:50.655283 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 621/1236] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 15:03:50 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 15:03:53.235992 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fc4fc-1619-4436-af84-46a747d364f5 service nova] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:03:53.246264 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fc4fc-1619-4436-af84-46a747d364f5 service nova] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:03:53.250020 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce10de-8f79-4f03-8baa-393250dba22f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:03:53.250811 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce10de-8f79-4f03-8baa-393250dba22f service neutron] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:03:53.251090 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce10de-8f79-4f03-8baa-393250dba22f service neutron] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:03:53.251356 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce10de-8f79-4f03-8baa-393250dba22f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:03:53.259971 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce10de-8f79-4f03-8baa-393250dba22f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:03:53.261297 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce10de-8f79-4f03-8baa-393250dba22f service neutron] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:03:53.269616 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 616/1237] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 15:03:53 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 15:04:00.650885 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=16 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:04:03.266052 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=12 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:04:06.423841 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e228529-b4b2-4863-ac8b-cedf13dad9e6 None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:04:06.424412 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e228529-b4b2-4863-ac8b-cedf13dad9e6 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:04:06.424643 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e228529-b4b2-4863-ac8b-cedf13dad9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:04:06.444965 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-8e228529-b4b2-4863-ac8b-cedf13dad9e6 None None] MFA Rules not processed for user `dab39fe6f0b44d70a83ff3cc9f8fccb6`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 15:04:06.446262 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-8e228529-b4b2-4863-ac8b-cedf13dad9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 15:04:06.453227 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 622/1238] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 15:04:06 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 15:04:06.724559 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce10de-8f79-4f03-8baa-393250dba22f service neutron] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:04:06.732993 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce10de-8f79-4f03-8baa-393250dba22f service neutron] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:04:06.736620 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a326916-f262-4301-8819-0f7fe4a32eef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:04:06.737204 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a326916-f262-4301-8819-0f7fe4a32eef service neutron] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:04:06.737482 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a326916-f262-4301-8819-0f7fe4a32eef service neutron] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:04:06.737783 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a326916-f262-4301-8819-0f7fe4a32eef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:04:06.745644 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a326916-f262-4301-8819-0f7fe4a32eef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:04:06.747420 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a326916-f262-4301-8819-0f7fe4a32eef service neutron] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:04:06.758828 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 617/1239] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 15:04:06 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 15:04:07.107500 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e228529-b4b2-4863-ac8b-cedf13dad9e6 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:04:07.124942 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e228529-b4b2-4863-ac8b-cedf13dad9e6 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:04:07.132833 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808048c-0f95-42fe-b089-f1c5ecd83468 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff30f486b0964765bef7665e2b2a9e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:04:07.134237 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808048c-0f95-42fe-b089-f1c5ecd83468 service placement] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:04:07.134730 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808048c-0f95-42fe-b089-f1c5ecd83468 service placement] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:04:07.135195 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808048c-0f95-42fe-b089-f1c5ecd83468 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:04:07.147275 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808048c-0f95-42fe-b089-f1c5ecd83468 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:04:07.149618 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808048c-0f95-42fe-b089-f1c5ecd83468 service placement] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:04:07.161825 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 623/1240] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 15:04:07 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 15:04:16.753107 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=6 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:04:17.156392 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=9 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:04:19.616828 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a326916-f262-4301-8819-0f7fe4a32eef service neutron] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:04:19.629358 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a326916-f262-4301-8819-0f7fe4a32eef service neutron] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:04:19.634620 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37dbd4-f399-41e7-ba7f-2ea1e79cf9cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:04:19.635196 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37dbd4-f399-41e7-ba7f-2ea1e79cf9cb service nova] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:04:19.635469 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37dbd4-f399-41e7-ba7f-2ea1e79cf9cb service nova] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:04:19.635731 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37dbd4-f399-41e7-ba7f-2ea1e79cf9cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:04:19.644032 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37dbd4-f399-41e7-ba7f-2ea1e79cf9cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:04:19.645580 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37dbd4-f399-41e7-ba7f-2ea1e79cf9cb service nova] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:04:19.655165 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 618/1241] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 15:04:19 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 15:04:24.631017 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808048c-0f95-42fe-b089-f1c5ecd83468 service placement] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:04:24.643399 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808048c-0f95-42fe-b089-f1c5ecd83468 service placement] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:04:24.648860 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7a7b7-daf2-474d-be48-1eb8c9cea3f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:04:24.649553 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7a7b7-daf2-474d-be48-1eb8c9cea3f5 service nova] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:04:24.649853 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7a7b7-daf2-474d-be48-1eb8c9cea3f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:04:24.650192 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7a7b7-daf2-474d-be48-1eb8c9cea3f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:04:24.660266 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7a7b7-daf2-474d-be48-1eb8c9cea3f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:04:24.661890 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7a7b7-daf2-474d-be48-1eb8c9cea3f5 service nova] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:04:24.673225 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 624/1242] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 15:04:24 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 15:04:29.651139 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=6 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:04:33.074839 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37dbd4-f399-41e7-ba7f-2ea1e79cf9cb service nova] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:04:33.084685 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37dbd4-f399-41e7-ba7f-2ea1e79cf9cb service nova] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:04:33.088479 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11b2ae-e559-4185-b32f-f3b9549c3ae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:04:33.089090 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11b2ae-e559-4185-b32f-f3b9549c3ae5 service neutron] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:04:33.089396 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11b2ae-e559-4185-b32f-f3b9549c3ae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:04:33.089870 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11b2ae-e559-4185-b32f-f3b9549c3ae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:04:33.102066 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11b2ae-e559-4185-b32f-f3b9549c3ae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:04:33.103476 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11b2ae-e559-4185-b32f-f3b9549c3ae5 service neutron] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:04:33.112793 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 619/1243] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 15:04:33 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 15:04:34.668391 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=6 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:04:34.773587 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7a7b7-daf2-474d-be48-1eb8c9cea3f5 service nova] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:04:34.785067 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7a7b7-daf2-474d-be48-1eb8c9cea3f5 service nova] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:04:34.790787 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878d545-007e-4df2-ab5e-01869b5dcd04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aca6a001d3b479bab684772768d49f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:04:34.791588 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878d545-007e-4df2-ab5e-01869b5dcd04 service nova] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:04:34.792177 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878d545-007e-4df2-ab5e-01869b5dcd04 service nova] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:04:34.792602 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878d545-007e-4df2-ab5e-01869b5dcd04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:04:34.802482 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878d545-007e-4df2-ab5e-01869b5dcd04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:04:34.804558 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878d545-007e-4df2-ab5e-01869b5dcd04 service nova] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:04:34.829023 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 625/1244] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 15:04:34 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 15:04:43.108694 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=6 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:04:44.812331 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=6 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:05:22.484344 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da636019-206d-4a68-92d9-8b250c4bba3f None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:05:22.484844 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da636019-206d-4a68-92d9-8b250c4bba3f None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:05:22.484938 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da636019-206d-4a68-92d9-8b250c4bba3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:05:22.504047 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-da636019-206d-4a68-92d9-8b250c4bba3f None None] MFA Rules not processed for user `a185b1c40a6b404697dca78b8b3cacae`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 15:05:22.505221 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-da636019-206d-4a68-92d9-8b250c4bba3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 15:05:22.513044 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 620/1245] 10.222.0.30 () {58 vars in 958 bytes} [Wed Aug 17 15:05:22 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 15:05:32.499315 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=3 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:07:06.995236 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878d545-007e-4df2-ab5e-01869b5dcd04 service nova] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:07:06.996826 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-1878d545-007e-4df2-ab5e-01869b5dcd04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 15:07:07.039246 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878d545-007e-4df2-ab5e-01869b5dcd04 service nova] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:07:07.042886 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991339f-fb40-44d5-962d-08291388b56d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:07:07.043476 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991339f-fb40-44d5-962d-08291388b56d service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:07:07.043749 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991339f-fb40-44d5-962d-08291388b56d service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:07:07.044016 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991339f-fb40-44d5-962d-08291388b56d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:07:07.131915 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991339f-fb40-44d5-962d-08291388b56d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:07:07.133286 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991339f-fb40-44d5-962d-08291388b56d service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:07:07.151800 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 626/1246] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 15:07:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 15:07:10.579179 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc24222-05c8-4a3e-bba7-ed05d9cb364a None None] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:07:10.579712 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc24222-05c8-4a3e-bba7-ed05d9cb364a None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:07:10.579712 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc24222-05c8-4a3e-bba7-ed05d9cb364a None None] PATH_INFO: `/` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:07:10.581693 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 621/1247] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 17 15:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 15:07:10.610374 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20b5a4-d268-49ec-b012-90c2169ce5da None None] REQUEST_METHOD: `POST` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:07:10.610893 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20b5a4-d268-49ec-b012-90c2169ce5da None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:07:10.610978 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20b5a4-d268-49ec-b012-90c2169ce5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:07:10.699595 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.auth.core [None req-9e20b5a4-d268-49ec-b012-90c2169ce5da None None] MFA Rules not processed for user `ff30f486b0964765bef7665e2b2a9e35`. Rule list: `[]` (Enabled: `True`). {{(pid=88157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 15:07:10.700822 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-9e20b5a4-d268-49ec-b012-90c2169ce5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 15:07:10.710936 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 627/1248] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 17 15:07:10 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 15:07:10.721363 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc24222-05c8-4a3e-bba7-ed05d9cb364a None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:07:10.735296 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc24222-05c8-4a3e-bba7-ed05d9cb364a None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:07:10.741230 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffbef3-4d93-4651-8b47-5609423784d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff30f486b0964765bef7665e2b2a9e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:07:10.741854 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffbef3-4d93-4651-8b47-5609423784d4 service placement] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:07:10.742132 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffbef3-4d93-4651-8b47-5609423784d4 service placement] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:07:10.742397 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffbef3-4d93-4651-8b47-5609423784d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:07:10.750975 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffbef3-4d93-4651-8b47-5609423784d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:07:10.752602 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffbef3-4d93-4651-8b47-5609423784d4 service placement] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:07:10.762887 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 622/1249] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 15:07:10 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 15:07:13.867641 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dff64-fedc-4d6f-8926-ab8a2ff0a006 None None] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:07:13.868144 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dff64-fedc-4d6f-8926-ab8a2ff0a006 None None] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:07:13.868327 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dff64-fedc-4d6f-8926-ab8a2ff0a006 None None] PATH_INFO: `/` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:07:13.869624 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 628/1250] 10.222.0.30 () {54 vars in 921 bytes} [Wed Aug 17 15:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 15:07:13.874512 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e48c4-8f19-481c-b70e-0904681266f0 None None] REQUEST_METHOD: `POST` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:07:13.874923 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e48c4-8f19-481c-b70e-0904681266f0 None None] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:07:13.875101 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e48c4-8f19-481c-b70e-0904681266f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:07:13.894021 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.auth.core [None req-e60e48c4-8f19-481c-b70e-0904681266f0 None None] MFA Rules not processed for user `ff30f486b0964765bef7665e2b2a9e35`. Rule list: `[]` (Enabled: `True`). {{(pid=88156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 15:07:13.895215 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-e60e48c4-8f19-481c-b70e-0904681266f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 15:07:13.904614 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 623/1251] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Aug 17 15:07:13 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 15:07:13.919930 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4dff64-fedc-4d6f-8926-ab8a2ff0a006 None None] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:07:13.937106 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4dff64-fedc-4d6f-8926-ab8a2ff0a006 None None] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:07:13.939269 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e48c4-8f19-481c-b70e-0904681266f0 None None] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:07:13.943053 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64345a0-3890-4ed7-a840-d52337b95ed6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff30f486b0964765bef7665e2b2a9e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:07:13.943905 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64345a0-3890-4ed7-a840-d52337b95ed6 service placement] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:07:13.944346 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64345a0-3890-4ed7-a840-d52337b95ed6 service placement] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:07:13.944622 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64345a0-3890-4ed7-a840-d52337b95ed6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:07:13.950591 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e48c4-8f19-481c-b70e-0904681266f0 None None] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:07:13.954865 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64345a0-3890-4ed7-a840-d52337b95ed6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:07:13.957002 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64345a0-3890-4ed7-a840-d52337b95ed6 service placement] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:07:13.966414 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fc70f-026c-45e0-b057-ccdfe0fb5fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:07:13.967082 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fc70f-026c-45e0-b057-ccdfe0fb5fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:07:13.967357 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fc70f-026c-45e0-b057-ccdfe0fb5fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:07:13.967625 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fc70f-026c-45e0-b057-ccdfe0fb5fd4 admin admin] PATH_INFO: `/v3/users/dab39fe6f0b44d70a83ff3cc9f8fccb6` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:07:13.968841 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fc70f-026c-45e0-b057-ccdfe0fb5fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab39fe6f0b44d70a83ff3cc9f8fccb6)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:07:13.969991 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: WARNING py.warnings [None req-176fc70f-026c-45e0-b057-ccdfe0fb5fd4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 15:07:13.969991 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: warnings.warn(msg) Aug 17 15:07:13.969991 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: Aug 17 15:07:13.971340 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fc70f-026c-45e0-b057-ccdfe0fb5fd4 admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:07:13.972554 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 629/1252] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 15:07:13 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 15:07:14.045171 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-176fc70f-026c-45e0-b057-ccdfe0fb5fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab39fe6f0b44d70a83ff3cc9f8fccb6'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:07:14.058695 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-176fc70f-026c-45e0-b057-ccdfe0fb5fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab39fe6f0b44d70a83ff3cc9f8fccb6'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:07:14.059445 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-176fc70f-026c-45e0-b057-ccdfe0fb5fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab39fe6f0b44d70a83ff3cc9f8fccb6'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:07:14.067135 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-176fc70f-026c-45e0-b057-ccdfe0fb5fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab39fe6f0b44d70a83ff3cc9f8fccb6'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:07:14.088542 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-176fc70f-026c-45e0-b057-ccdfe0fb5fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab39fe6f0b44d70a83ff3cc9f8fccb6'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:07:14.095017 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 624/1253] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 17 15:07:13 2022] DELETE /identity/v3/users/dab39fe6f0b44d70a83ff3cc9f8fccb6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 15:07:14.267088 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64345a0-3890-4ed7-a840-d52337b95ed6 service placement] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:07:14.279261 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64345a0-3890-4ed7-a840-d52337b95ed6 service placement] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:07:14.305719 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=100 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:07:14.341309 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c2eb0-bd9c-4372-9830-e57843b8d3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:07:14.341992 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c2eb0-bd9c-4372-9830-e57843b8d3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:07:14.342275 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c2eb0-bd9c-4372-9830-e57843b8d3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:07:14.342553 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c2eb0-bd9c-4372-9830-e57843b8d3ef admin admin] PATH_INFO: `/v3/projects/827b951e26dc475dbfb538fd09911172` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:07:14.343674 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c2eb0-bd9c-4372-9830-e57843b8d3ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=827b951e26dc475dbfb538fd09911172)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:07:14.344698 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: WARNING py.warnings [None req-a00c2eb0-bd9c-4372-9830-e57843b8d3ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 15:07:14.344698 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: warnings.warn(msg) Aug 17 15:07:14.344698 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: Aug 17 15:07:14.345903 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c2eb0-bd9c-4372-9830-e57843b8d3ef admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:07:14.401502 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-a00c2eb0-bd9c-4372-9830-e57843b8d3ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '827b951e26dc475dbfb538fd09911172', 'request_id': 'req-a00c2eb0-bd9c-4372-9830-e57843b8d3ef'} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:07:14.408874 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-a00c2eb0-bd9c-4372-9830-e57843b8d3ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '827b951e26dc475dbfb538fd09911172', 'request_id': 'req-a00c2eb0-bd9c-4372-9830-e57843b8d3ef'} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:07:14.422682 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-a00c2eb0-bd9c-4372-9830-e57843b8d3ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '827b951e26dc475dbfb538fd09911172', 'request_id': 'req-a00c2eb0-bd9c-4372-9830-e57843b8d3ef'} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:07:14.447284 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-a00c2eb0-bd9c-4372-9830-e57843b8d3ef admin admin] The token cache is being invalidate because project 827b951e26dc475dbfb538fd09911172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 15:07:14.447513 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-a00c2eb0-bd9c-4372-9830-e57843b8d3ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:07:14.448122 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-a00c2eb0-bd9c-4372-9830-e57843b8d3ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:07:14.449609 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 630/1254] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 17 15:07:14 2022] DELETE /identity/v3/projects/827b951e26dc475dbfb538fd09911172 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 15:07:14.454124 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fc70f-026c-45e0-b057-ccdfe0fb5fd4 admin admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:07:14.455573 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-176fc70f-026c-45e0-b057-ccdfe0fb5fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 15:07:14.469779 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fc70f-026c-45e0-b057-ccdfe0fb5fd4 admin admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:07:14.525625 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cfe13-ace1-4e80-a84f-6cea00111ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:07:14.526292 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cfe13-ace1-4e80-a84f-6cea00111ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:07:14.526574 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cfe13-ace1-4e80-a84f-6cea00111ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:07:14.526856 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cfe13-ace1-4e80-a84f-6cea00111ba3 admin admin] PATH_INFO: `/v3/users/1d71f9680a8247799e4a6cdb7f81389a` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:07:14.528032 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0cfe13-ace1-4e80-a84f-6cea00111ba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d71f9680a8247799e4a6cdb7f81389a)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:07:14.529981 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0cfe13-ace1-4e80-a84f-6cea00111ba3 admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:07:14.575879 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-bc0cfe13-ace1-4e80-a84f-6cea00111ba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d71f9680a8247799e4a6cdb7f81389a'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:07:14.581073 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:07:14.583326 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-bc0cfe13-ace1-4e80-a84f-6cea00111ba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d71f9680a8247799e4a6cdb7f81389a'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:07:14.584448 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-bc0cfe13-ace1-4e80-a84f-6cea00111ba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d71f9680a8247799e4a6cdb7f81389a'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:07:14.592435 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-bc0cfe13-ace1-4e80-a84f-6cea00111ba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d71f9680a8247799e4a6cdb7f81389a'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:07:14.604458 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-bc0cfe13-ace1-4e80-a84f-6cea00111ba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d71f9680a8247799e4a6cdb7f81389a'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:07:14.610374 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 625/1255] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 17 15:07:14 2022] DELETE /identity/v3/users/1d71f9680a8247799e4a6cdb7f81389a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 15:07:14.785715 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c2eb0-bd9c-4372-9830-e57843b8d3ef admin admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:07:14.787752 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-a00c2eb0-bd9c-4372-9830-e57843b8d3ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 15:07:14.801496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c2eb0-bd9c-4372-9830-e57843b8d3ef admin admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:07:14.860674 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b7399-ab9a-492e-bba4-6de85979cddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:07:14.861309 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b7399-ab9a-492e-bba4-6de85979cddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:07:14.861588 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b7399-ab9a-492e-bba4-6de85979cddb admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:07:14.862172 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b7399-ab9a-492e-bba4-6de85979cddb admin admin] PATH_INFO: `/v3/projects/1d2d5559908245a1a8a3ea4f399c3440` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:07:14.863287 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b7399-ab9a-492e-bba4-6de85979cddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d2d5559908245a1a8a3ea4f399c3440)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:07:14.865240 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b7399-ab9a-492e-bba4-6de85979cddb admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:07:14.910644 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:07:14.912264 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-093b7399-ab9a-492e-bba4-6de85979cddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d2d5559908245a1a8a3ea4f399c3440', 'request_id': 'req-093b7399-ab9a-492e-bba4-6de85979cddb'} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:07:14.920373 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-093b7399-ab9a-492e-bba4-6de85979cddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d2d5559908245a1a8a3ea4f399c3440', 'request_id': 'req-093b7399-ab9a-492e-bba4-6de85979cddb'} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:07:14.926965 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-093b7399-ab9a-492e-bba4-6de85979cddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d2d5559908245a1a8a3ea4f399c3440', 'request_id': 'req-093b7399-ab9a-492e-bba4-6de85979cddb'} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:07:14.937343 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-093b7399-ab9a-492e-bba4-6de85979cddb admin admin] The token cache is being invalidate because project 1d2d5559908245a1a8a3ea4f399c3440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 15:07:14.937622 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-093b7399-ab9a-492e-bba4-6de85979cddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:07:14.938261 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-093b7399-ab9a-492e-bba4-6de85979cddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:07:14.939712 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 631/1256] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 17 15:07:14 2022] DELETE /identity/v3/projects/1d2d5559908245a1a8a3ea4f399c3440 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 15:07:24.606822 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=9,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:07:24.934496 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=7,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:07:49.984361 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cfe13-ace1-4e80-a84f-6cea00111ba3 admin admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:07:49.987387 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-bc0cfe13-ace1-4e80-a84f-6cea00111ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 15:07:50.056164 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cfe13-ace1-4e80-a84f-6cea00111ba3 admin admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:07:50.113694 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d57f24-6a4f-4d11-9189-67a68bde82a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff30f486b0964765bef7665e2b2a9e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:07:50.114337 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d57f24-6a4f-4d11-9189-67a68bde82a4 service placement] REQUEST_METHOD: `GET` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:07:50.114611 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d57f24-6a4f-4d11-9189-67a68bde82a4 service placement] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:07:50.114875 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d57f24-6a4f-4d11-9189-67a68bde82a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:07:50.116556 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-56d57f24-6a4f-4d11-9189-67a68bde82a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 15:07:50.127152 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d57f24-6a4f-4d11-9189-67a68bde82a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:07:50.129197 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d57f24-6a4f-4d11-9189-67a68bde82a4 service placement] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:07:50.138656 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 626/1257] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 15:07:49 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 15:08:00.134903 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=58 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:08:00.873121 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b7399-ab9a-492e-bba4-6de85979cddb admin admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:08:00.874609 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-093b7399-ab9a-492e-bba4-6de85979cddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 15:08:00.937540 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b7399-ab9a-492e-bba4-6de85979cddb admin admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:08:00.941424 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8c8a7-0fbe-4238-b85d-4fa6b351beeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4147647f54499ba24b50fbecc5d38f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9d40280440c4d25b6d60a431d6f788b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:08:00.942877 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8c8a7-0fbe-4238-b85d-4fa6b351beeb service neutron] REQUEST_METHOD: `GET` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:08:00.943329 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8c8a7-0fbe-4238-b85d-4fa6b351beeb service neutron] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:08:00.943605 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8c8a7-0fbe-4238-b85d-4fa6b351beeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:08:00.945755 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-97c8c8a7-0fbe-4238-b85d-4fa6b351beeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 15:08:01.008795 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8c8a7-0fbe-4238-b85d-4fa6b351beeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:08:01.010315 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8c8a7-0fbe-4238-b85d-4fa6b351beeb service neutron] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:08:01.019686 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 632/1258] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Aug 17 15:08:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 15:08:07.288805 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d57f24-6a4f-4d11-9189-67a68bde82a4 service placement] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:08:07.290333 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-56d57f24-6a4f-4d11-9189-67a68bde82a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 15:08:07.304614 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d57f24-6a4f-4d11-9189-67a68bde82a4 service placement] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:08:07.309224 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d70d2-af37-436d-a37c-17d4791bb6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:08:07.309872 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d70d2-af37-436d-a37c-17d4791bb6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:08:07.310155 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d70d2-af37-436d-a37c-17d4791bb6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:08:07.310428 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d70d2-af37-436d-a37c-17d4791bb6e7 admin admin] PATH_INFO: `/v3/users/a185b1c40a6b404697dca78b8b3cacae` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:08:07.311539 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d70d2-af37-436d-a37c-17d4791bb6e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a185b1c40a6b404697dca78b8b3cacae)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:08:07.313474 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d70d2-af37-436d-a37c-17d4791bb6e7 admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:08:07.364745 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-cd0d70d2-af37-436d-a37c-17d4791bb6e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a185b1c40a6b404697dca78b8b3cacae'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:08:07.371360 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-cd0d70d2-af37-436d-a37c-17d4791bb6e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a185b1c40a6b404697dca78b8b3cacae'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:08:07.372014 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-cd0d70d2-af37-436d-a37c-17d4791bb6e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a185b1c40a6b404697dca78b8b3cacae'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:08:07.380260 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-cd0d70d2-af37-436d-a37c-17d4791bb6e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a185b1c40a6b404697dca78b8b3cacae'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:08:07.391932 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-cd0d70d2-af37-436d-a37c-17d4791bb6e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a185b1c40a6b404697dca78b8b3cacae'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:08:07.397668 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 627/1259] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 17 15:08:07 2022] DELETE /identity/v3/users/a185b1c40a6b404697dca78b8b3cacae => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 15:08:07.572514 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8c8a7-0fbe-4238-b85d-4fa6b351beeb service neutron] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:08:07.583544 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8c8a7-0fbe-4238-b85d-4fa6b351beeb service neutron] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:08:07.640159 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c9016-eaaa-4c5d-8012-c4d8f67e4af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:08:07.640790 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c9016-eaaa-4c5d-8012-c4d8f67e4af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:08:07.641073 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c9016-eaaa-4c5d-8012-c4d8f67e4af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:08:07.641347 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c9016-eaaa-4c5d-8012-c4d8f67e4af6 admin admin] PATH_INFO: `/v3/projects/340a130604ef4dc68580a032db80174f` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:08:07.642511 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c9016-eaaa-4c5d-8012-c4d8f67e4af6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=340a130604ef4dc68580a032db80174f)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:08:07.644415 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c9016-eaaa-4c5d-8012-c4d8f67e4af6 admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:08:07.690241 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-bc4c9016-eaaa-4c5d-8012-c4d8f67e4af6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '340a130604ef4dc68580a032db80174f', 'request_id': 'req-bc4c9016-eaaa-4c5d-8012-c4d8f67e4af6'} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:08:07.692889 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:08:07.698592 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-bc4c9016-eaaa-4c5d-8012-c4d8f67e4af6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '340a130604ef4dc68580a032db80174f', 'request_id': 'req-bc4c9016-eaaa-4c5d-8012-c4d8f67e4af6'} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:08:07.705925 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-bc4c9016-eaaa-4c5d-8012-c4d8f67e4af6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '340a130604ef4dc68580a032db80174f', 'request_id': 'req-bc4c9016-eaaa-4c5d-8012-c4d8f67e4af6'} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:08:07.716605 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-bc4c9016-eaaa-4c5d-8012-c4d8f67e4af6 admin admin] The token cache is being invalidate because project 340a130604ef4dc68580a032db80174f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 15:08:07.716889 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-bc4c9016-eaaa-4c5d-8012-c4d8f67e4af6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:08:07.717532 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-bc4c9016-eaaa-4c5d-8012-c4d8f67e4af6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:08:07.720742 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 633/1260] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 17 15:08:07 2022] DELETE /identity/v3/projects/340a130604ef4dc68580a032db80174f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 15:08:07.725561 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d70d2-af37-436d-a37c-17d4791bb6e7 admin admin] Authenticating user token {{(pid=88156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:08:07.726999 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.fernet_utils [None req-cd0d70d2-af37-436d-a37c-17d4791bb6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 15:08:07.740302 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d70d2-af37-436d-a37c-17d4791bb6e7 admin admin] Validating token access rules against request {{(pid=88156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:08:07.795307 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ef266-a653-4b1e-b7d7-d1603bcb2ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:08:07.795853 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ef266-a653-4b1e-b7d7-d1603bcb2ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:08:07.796134 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ef266-a653-4b1e-b7d7-d1603bcb2ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:08:07.796405 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ef266-a653-4b1e-b7d7-d1603bcb2ef5 admin admin] PATH_INFO: `/v3/users/23da6bfb3673411486cff26bfaf94cb3` {{(pid=88156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:08:07.797498 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ef266-a653-4b1e-b7d7-d1603bcb2ef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23da6bfb3673411486cff26bfaf94cb3)` {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:08:07.799441 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ef266-a653-4b1e-b7d7-d1603bcb2ef5 admin admin] RBAC: Authorization granted {{(pid=88156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:08:07.844797 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-733ef266-a653-4b1e-b7d7-d1603bcb2ef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23da6bfb3673411486cff26bfaf94cb3'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:08:07.852926 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-733ef266-a653-4b1e-b7d7-d1603bcb2ef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23da6bfb3673411486cff26bfaf94cb3'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:08:07.853633 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-733ef266-a653-4b1e-b7d7-d1603bcb2ef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23da6bfb3673411486cff26bfaf94cb3'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:08:07.861186 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-733ef266-a653-4b1e-b7d7-d1603bcb2ef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23da6bfb3673411486cff26bfaf94cb3'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:08:07.869454 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:08:07.874440 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG keystone.notifications [None req-733ef266-a653-4b1e-b7d7-d1603bcb2ef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23da6bfb3673411486cff26bfaf94cb3'} {{(pid=88156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:08:07.881902 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: [pid: 88156|app: 0|req: 628/1261] 10.222.0.30 () {58 vars in 1224 bytes} [Wed Aug 17 15:08:07 2022] DELETE /identity/v3/users/23da6bfb3673411486cff26bfaf94cb3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 15:08:08.058470 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c9016-eaaa-4c5d-8012-c4d8f67e4af6 admin admin] Authenticating user token {{(pid=88157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 15:08:08.059958 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.fernet_utils [None req-bc4c9016-eaaa-4c5d-8012-c4d8f67e4af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 15:08:08.073994 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c9016-eaaa-4c5d-8012-c4d8f67e4af6 admin admin] Validating token access rules against request {{(pid=88157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 15:08:08.131440 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aae042-b01a-4b24-b6a1-cacb77cf7859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b2dd9ba613b47b8b4618c0c2e6e4e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09a5e42d9b6e4e598b40571f10c289e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 15:08:08.132061 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aae042-b01a-4b24-b6a1-cacb77cf7859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 15:08:08.132339 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aae042-b01a-4b24-b6a1-cacb77cf7859 admin admin] SCRIPT_NAME: `/identity` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 15:08:08.132610 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aae042-b01a-4b24-b6a1-cacb77cf7859 admin admin] PATH_INFO: `/v3/projects/fb59738745c84ebd826f8ddf38e8090b` {{(pid=88157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 15:08:08.133702 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aae042-b01a-4b24-b6a1-cacb77cf7859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb59738745c84ebd826f8ddf38e8090b)` {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 15:08:08.135689 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aae042-b01a-4b24-b6a1-cacb77cf7859 admin admin] RBAC: Authorization granted {{(pid=88157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 15:08:08.180806 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-f1aae042-b01a-4b24-b6a1-cacb77cf7859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb59738745c84ebd826f8ddf38e8090b', 'request_id': 'req-f1aae042-b01a-4b24-b6a1-cacb77cf7859'} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:08:08.188261 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-f1aae042-b01a-4b24-b6a1-cacb77cf7859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb59738745c84ebd826f8ddf38e8090b', 'request_id': 'req-f1aae042-b01a-4b24-b6a1-cacb77cf7859'} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:08:08.195277 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-f1aae042-b01a-4b24-b6a1-cacb77cf7859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb59738745c84ebd826f8ddf38e8090b', 'request_id': 'req-f1aae042-b01a-4b24-b6a1-cacb77cf7859'} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:08:08.205214 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-f1aae042-b01a-4b24-b6a1-cacb77cf7859 admin admin] The token cache is being invalidate because project fb59738745c84ebd826f8ddf38e8090b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 15:08:08.205478 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-f1aae042-b01a-4b24-b6a1-cacb77cf7859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:08:08.206116 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG keystone.notifications [None req-f1aae042-b01a-4b24-b6a1-cacb77cf7859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 15:08:08.208326 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: [pid: 88157|app: 0|req: 634/1262] 10.222.0.30 () {58 vars in 1233 bytes} [Wed Aug 17 15:08:08 2022] DELETE /identity/v3/projects/fb59738745c84ebd826f8ddf38e8090b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 15:08:17.878747 dv-osbrick-853500-1-ceph devstack@keystone.service[88156]: DEBUG dbcounter [-] [88156] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=88156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 15:08:18.202356 dv-osbrick-853500-1-ceph devstack@keystone.service[88157]: DEBUG dbcounter [-] [88157] Writing DB stats keystone:DELETE=10,keystone:SELECT=57,keystone:INSERT=1 {{(pid=88157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}